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ie) ENVIRONMENT AND OBJECTIVES 


ive imereasing complexity of military tactics and 
equipment is placing major emphasis on evaluation of human 
performance as an integral part of the man-machine system. 
Technological advances result in new military equipment 
being developed for the Army to meet the anticipated 
requirements of the modern battlefield. Some of these 
advances will allow continuous operations without resupply 
or maintenance. The expanded equipment capabilities will 
place increased demands on the soldiers who will operate the 
Sammement. [|[Ref. 1: p. 3] 

Mobility and high tempo of combat operations is one of 
the seven principles of tactical doctrine followed by the 
Serwmee Union s ground forces. The requirement of this 
Pemametele, Dasically, 1s to achieve and sustain rapid 
movement of combat forces. Pnemprminciole includes tne 
battlefield mobility of maneuver forces, the maneuverability 
SEemetae SUDPOrt, and the mobility of logistics elements to 
Sustain operations. A high tempo relates to the relentless 
execution of an operation without pause. The Soviets feel 
it is critical to keep the enemy off balance and under 
constant pressure, thereby preventing the enemy from forming 


an effective defense {Ref. 2: pp. 1-6]. 





The improvements in equipment, coupled with the doctrine 
Sev oaeSaw Pact nations to Conduct protracted operations, 
indicate that today's soldier is more likely to participate 
in sustained operations than ever before. 

fee Uses. Army, through several of Zts research and 
development agencies, has used and will continue to use 
combat simulations as a means for planning, testing, and 
evaluating weapons systems, tactics, and strategies at all 
organizational levels. Included as part of combat models 
and simulations should be data that takes into account 
performance degradation of a unit and its members that 
occurs when they are subjected to periods of continuous 
operations. Seem data resultime from fresearch into 
performance degradation through actual evaluations of 
performance in the field do not exist. In situations where 
planners require information on human performance, they must 
rely almost entirely on judgments based on past experience. 
These judgments become more invalid as tactics, strategies, 
and equipment change and become more sophisticated. [Ref. 


Sao. l= 2 | 


A. EVALUATION SYSTEM 

In order to determine what effect continuous operations 
have ona unit's performance, a controlled, realistic, and 
accurate evaluation system 1S required. The ultimate 


objective of such a system is to provide measured data 





peaorne tnsight to how much, if any, a unit's performance is 
degraded due to sustained operations. These data would 
provide a means to investigate the effectiveness of units 
weet a prolonged period of time and allow planning 
considerations, adjustments, and compensations for degraded 
performance to be made so that improved effectiveness may be 
obtained from units subjected to sustained combat 
Gomaltions. Such data would add the realism needed in 
current combat simulation models. This paper establishes 
guidelines for an evaluation system to measure performance 
degradation over a period of continuous operations and to 
provide the needed data. 

The setting for such an evaluation PG TERee a field 
environment rather than a laboratory experiment. A 
laboratory experiment is normally not appropriate for an 
evaluation of this type for the following reasons: 


a) only a few independent variables are selected and many 
important interactions may be excluded. 


b) the character of the variables is often changed in the 
laboratory. 
c) experimental conditions are so well controlled that 


Significant differences found in the laboratory are 
Paieer stouna EO be of no practical importance in the 
fee eels 

dad) the methods used to present variables are unrealistic. 


e) criteria are chosen for convenience rather than 
relevance. [Ref. 3: p. 3] 


A field environment, such as the National Training Center at 


Fort Irwin, California would serve as an ideal location for 





evaluation of sustained operations. The suitability of this 
Pmeeronment is discussed in Chapter IV. The evaluation 
Soc em 1S designed to consider battalion size units, 
peeeltiaeallysconsidering four levels within the battalion: 

-- Battalion command and control 

-- Rifle companies 

-- Special platoons 

-- Individual soldiers 

Be S@CBIJECTIVES 
Mimeoucgh this design the following objectives are 
established for the evaluation system: 

slo measure the amount of unit and individual 
degradations in performance during a period of 
continuous operations from that of baseline 
Gendielons. 

-- To establish a realistic data base for use in existing 
models and for the construction of more accurate 
combat models which can support developments in 
tactics, strategy, and equipment. 

-- To obtain data on the effectiveness of the internal 
organization of a combined arms force while operating 
for sustained periods of time. 

-- To obtain data which shows the impact of different 
training techniques to enhance the ability of a 
SComormed arms force EO conduceE its missions over a 
period of continuous operations. [{Ref. 4: p. 1-4] 

A well designed evaluation and a well executed effort to 
collect the necessary data could provide answers to a myriad 
of questions, in addition to meeting the stated objectives. 
Through use of the data in combat simulations versus 


expensive, hard to control, and sometimes impractical field 


tests, such things as deficiencies in doctrine, training, 


es 





Pier tel wana organization may be identified. Being able to 
Seqauee these simulations using reliable data obtained 
Ehzough this design may preclude deficiencies not being 
meaeecmaized Umei)] it is time to employ the System in combat. 
Seeerens Such as Ehe optimal time to relieve a unit of 
front line duty, time to commit reserve units, percentage of 
Seeemaen at which a unit can operate and still be effective, 
priority of reinforcements, etc., may all be addressed with 
some credibility. Further, once degradation in performance 
is detected, efforts may be directed to design systems, 
tactics, or strategies to compensate for that degradation. 
As such, the end result of the evaluation system should be 
data that is suitable and adaptable to combat models that 
are utilized for investigative purposes. 

Initially the focus on data generation and collection 
will be approached as if virtually no constraints exist on 
the amount or type of data to be collected. However itis 
iaemeaea that there wll be constraints in terms of 
manpower, time, and equipment to collect the data when such 
meov Seem 1S implemented. At that point, the data to™be 
collected may be tailored based on existing constraints. 
Care must be taken to balance the tradeoffs between reducing 
the amount of data to be collected and the usefulness of the 
data once it is gathered. It must be insured that 
sufficient data is assembled so that reliable conclusions 


may be drawn from data analysis. A significant portion of 
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this research effort involved the determination of 
performance indicators, criteria, and missions that are 
realistic and consistent with the objectives of this 
evaluation system. These factors are described in Chapter 
III and are fully documented in Appendices A through D (each 
appendix describing one level of the battalion to be 
evaluated). 

The design concepts of the evaluation system, presented 
in Chapter II, describe the evaluation procedures to include 
the type of data to be collected, the environment for data 
collection, and methods to measure performance and 
performance degradation. Examples of the types of data that 
are to be collected are given in Chapter III, demonstrating 
the different levels of performance indicators that are 
examined throughout the evaluation. Chapter IV describes 
the resources that exist at the National Training Center 
(Tee) at Fort Irwin, California and their suitability to the 
Suggested evaluation system. Implementing an evaluation 
system such as proposed in this paper will require a 
dedication by the Army to the stated objectives. Manpower 
Pome valuation control, data collection and analysis, as 
well as training areas, equipment and numerous other 
resources are needed if an evaluation of this type is to be 
successful. 

Procedures for the statistical evaluation of the data 


Sorebectedad under conditions of sustained and normal 








operations are discussed in Chapter V. These procedures 
address appropriate methodologies for evaluating whether 
performance differences occurred and, if so, the magnitude 
of the performance differences. The procedures are 
developed for both quantitative (ratio scale) data and 
subjective (interval scale) data. These performance 
differences are addressed at the individual performance 
indicator level, as well as the aggregated levels of 
Sateecmra and Missions. Finally the utilizations of the 
evaluation results for combat models and training audit 
trails are described in Chapter VI. 

The performance indicators, and their aggregation into 
criteria and missions, are presented in appendices A through 
Das previously discussed. A sample scenario for implemen- 
tation of the evaluation system is given in Appendix E. 
Specific statistical procedures required for data analysis 
described in Chapter V are given in Appendix F. 

In summary, the proposed evaluation system is designed 
homepEOvVide a methodology to investigate differences in 
performance between normal and continuous operations ina 
Pie wawenvyilronment. This paper indicates the steps and 


procedures required to realize such a system. 
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ii wot GN CONCEPTS OF THE EVALUATION SYSTEM 


a A EE 


In order to develop the design of an evaluation system 
for assessing performance differences of combat units in an 
Army Test and Evaluation Program (ARTEP)/NTC environment, 


the following issues must be resolved. [Ref. 5: p. 6] 


A. PERFORMANCE INDICATORS 

Before considering evaluation methods, the performance 
indicators for evaluation must be developed. These 
indicators will provide a means to measure the overall 
objectives of the evaluation and must be relevant to the 
purpose of the evaluation. In order to accomplish this, the 
performance indicators selected for evaluation are divided 
neem rour levels. The first level is related to the 
Piaeetonwcommander, his stafit,»rand some of the key assets 
available to him, noted as the battalion command and control 
level. This level is subdivided into missions, which are 
MuariteomaesuOGilvyided into criteria, which in turn are 
subdivided into performance indicators. For example, at the 
battalion command and control level the mission of the S-4 
Geemotics Grficer) 1s to provide logistics support. The 
Gm@iieenia that make up this mission are: 

-- Ability to Provide Essential Supplies 


-- Ability to Provide Transportation 
-- Ability to Provide Messing Operations 
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These criteria are evaluated using performance indicators. 
DMomeewencrbECrioOnm, Ability to Provide Essential Supplies, 
the performance indicators are: 

-~ percent request for supplies not met 


-- number of required and requested logistics reports not 
submitted 


-~- percent supply requests not delivered on time 
-- proportion of required and requested logistics reports 
not delivered on time [Ref. 4: p. 5-45] 

Performance indicators that relate to command and control 
were selected to investigate the possible degradation of 
performance at the battalion command level in continuous 
operations. It was felt that degradation at this level 
would lead to degraded performance at lower echelons and 
therefore the need to evaluate these performance indicators 
was deemed critical. The complete list of performance 
indicators for battalion command level are specified in 
Appendix A. 

The second level selected for evaluation is the rifle 
company. This level is also divided into missions. The 
missions to be evaluated for the rifle companies are: 

-- Movement to Contact 

-- Hasty Attack 

-- Deliberate Night Attack 

-- Delay 

-- Deliberate Defense 
For each mission undertaken by a company, there are criteria 
specified and these criteria are subdivided into performance 


indicators. Using the mission of Deliberate Defense as an 


example, the criteria are: 





~~ Preparation of Organization and Plan 

-- Oecupation of Fighting/Battle Position 

-- Establish Security 

-- Prepare Fighting Positions 

-- Defend as Opposing Force Approaches Positions 

-- Conduct a Counterattack 

-- Consolidation and Reorganization 

-- Ability to Acquire and Destroy Targets 

Pet liaty to Seize and Hold Terrain [Ref. 6: pp. 7-4-1 

~ 7-4-7] 

These criteria are evaluated using the specified performance 
indicators. DOI wENCmemnEerIOn, EStapliswescecurity, the 
performance indicators are the assessment of: 

~- use of observation posts on likely avenues of approach 

-- plan and use of patrols 

-- use of sentries 

-~- limited use of radio 

-- use of early warning devices on likely avenues of 

approach 

-- use of challenge and password 

~- alertness along perimeter 
Miter Missions and subsequent criteria and performance 
indicators are similar to those that are undertaken as part 
of a normal ARTEP evaluation and are discussed ina later 
Seecion of this chapter. The complete list of performance 
indicators for this level are defined in Appendix B. 

The third level to be evaluated is the specialized 
platoons organic to the infantry battalion, namely, the 
anti-tank platoon, the scout platoon, and the 107mm heavy 
HWOsecewetatoon. The importance of these platoons to the 
battalion's operation is critical and deserving of special 


Consideration. The platoons each have their own missions. 


The scout platoon's missions are to: 
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-- Conduct a Screen 

-- Conduct a Zone Reconnaissance 

-- Conduct an Area Reconnaissance 

-- Conduct a Route Reconnaissance 
The anti-tank and heavy mortar platoons’ missions are to 
peewee anti-tank fire support and indirect fire support, 
respectively. As in the case of the rifle companies, the 
special platoons’ missions are divided into criteria which 
paemeumener divided into performance indicators. For the 
scout platoon's mission of a Zone Reconnaissance, the 
criteria are: 

-- Plan and Prepare a Zone Reconnaissance 

-- Deploy Teams 

-- Locate Opposing Force 

-- Develop the Situation 

-- Collection of Terrain Specific Information 

-- Occupy an Assembly Area [Ref. 6: pp. 8-36-1 - 8-39-4] 
These criteria are then evaluated using the performance 
PmeemiCcarcers for each. POnpmeEne Criterion, Collection of 
ieamcarmaeopecific Information, the performance indicators 


awe. 


-- given opposing force has withdrawn, assessment of 
SSedinang and reporting information on: 


=) comea tion of road network in zone 

-- cross country trafficability 

-- obstacles and removal when possible 

-- bypasses around obstacles 

-- fords and water entry/exit points on water obstacles 
= eotnier iumtormation required by task force order 


= "eassessment of reports given by quickest and most 
secure means available during reconnaissance 


imemeomptece list of performance indicators for this level 


is given in Appendix C. 


1, 





The fourth level is that which pertains to the 
individual soldier. As a means to measure performance and 
performance degradation of the soldier, performance 
indicators associated with the common tasks a soldier is 
expected to perform were selected for the individual 
rifleman, for the soldier as a member of one of the special 
platoons, and the soldier with a specific job such as a 
machine gunner, radiotelephone operator, etc. For example, 
there are tasks that every soldier is expected to be able to 
perform, no matter what his primary duty position might be. 
These tasks are grouped together as: 


-- First Aid Tasks 

-- Nuclear, Biological, and Chemical Tasks 
-- Basic Individual Techniques 

-- Camoflauge, Cover and Concealment Tasks 
-- Security and Intelligence Tasks 

-- Land Navigation Tasks 

-- Night Vision Device Tasks 

-- M16A1 Rifle Tasks 

-- Light Anti-Tank Weapon (LAW) Tasks 

-- Hand Grenade Tasks 

-- Mine Tasks [Ref. 7: pp. 2-1 - 3-267] 


miemt1rst aid tasks consist of: 


ite yeto perform mouth to mouth resuscitation and 
external heart massage 

-- Ability to stop bleeding (arm or leg wound) 

-- Ability to identify signs of and treat for shock 

Paetorlaty to splint a fracture 

P= nevey to apply first aid Measures for burns 

= egeitay to apply first aid measures for heat injuries 

-- Ability to apply first aid measures for wet or cold 
injuries 


Miemncdivid@als with a specific job such as the M203 


Gpenedier have additional tasks such as: 
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Za OMetty. LO perkorm operator maintenamce on M203 
grenade launcher and ammunition 

-- Ability to load, unload, and clear the M203 

-- Ability to zero an M203 


-- Ability to engage targets with an M203 and apply 
immediate action to reduce a stoppage 

== Ability to use limited visibility firing techniques 
with the M203 


The tasks for individual evaluation are given in Appendix D. 


Beene SCENARTO 

For purposes of this evaluation, the measurement of 
performance inan NTC type environment is proposed to be 
the appropriate way of conducting the evaluation due to the 
lack of realism and validity currently available from other 
sources. EvVeme though problems of standardization, 
consistency, and control exist ina field environment, it is 
felt that the effort to Te potential distractors 1s 
necessary, rather than accepting higher levels of 
pameeiciality present in combat models. Conduct of the 
evaluation in the field, such as in an NTC type environment, 
will produce credible results if properly structured and 
executed. A well written scenario will assist in giving the 
evaluation the needed structure. 

In order to evaluate the performance indicators as 
described above, a scenario has been developed through which 
the actual evaluation of performance (as measured by the 
designated variables) will take place. The scenario will 
provide two capabilities to meet the objectives of this 


Syeuation. First, it will outline a plan of continuous 


a 





operations so that the effects on performance may be 
Baivesergated. Second, it will provide a logical sequence of 
events during which the performance indicators to be 
evaluated may be measured. The units to be evaluated will 
be expected to perform the following missions in accordance 


with the proposed schedule. 


Occupation of an Assembly Area 0700 DAY 1 
Conduct a Movement to Contact 1200-1600 DAY 1 
Conduct a Hasty Attack 1600 DAY 1 
Conduct a Deliberate Night 
Attack 0300 DAY 2 
Conduct a Delay (under enemy 
pressure) 1500-1800 DAY 2 
Conduct a Deliberate Delay from completion 

of delay (DAY 2) 

-0800 DAY 4 
Wenaucte Counterattack 0800-1100 DAY 4 


The units will be evaluated for a period of seventy-six 
neues. DUring that period the units will proceed from one 
mission to another in a sequence that a battalion might 
expect to receive its missions in combat, keeping the unit 
continuously deployed, yet with sufficient time to plan and 
@emaert 1tS Operations. Although the unlit is in the 
deliberate defense for approximately thirty-eight hours, it 
is felt the variety of tasks that must be performed and the 
physical requirements, such as constructing battle 
positions, providing security, and executing leaders' tasks 
are more than sufficiently demanding to keep the units 
occupied and stressed. The time schedule does not 
Setoiecitly show such activities as consolidation and 


reorganization after the attacks, which are required and 
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listed in the appendices as performance indicators to be 
measured. A complete scenario to support the time schedule 
has been written to provide all necessary details and will 
be given initially in the form of an operations order 
(OPORD) to the evaluated unit. Orders for a delay, 
deliberate defense, and other subsequent operations will be 
given as the evaluation continues in the form of fragmentary 
orders (FRAGO). These orders are issued ina manner that 
provides realism, continuity, and control. As such, the 
scenario satisfies the peatheenionts Gielen Metnicmoem=lnia us 
operations and allows the measurement of the performance 
teeeaters listed in Appendices A through D. A complete 


sample scenario is provided in Appendix E. 


Cy eee RPORMANCE MEASUREMENT TECHNIQUES 
The performance indicators to be measured have been 

identified and the environment and scenario in which to 
measure them have been determined. The next major task is 
to determine how to actually measure the performance 
indicators. To accomplish this, three factors must be taken 
ieee account: 

-- standards by which to measure performance 

-- who will do the evaluating 

-- means of control over evaluation 
The standards by which to measure performance, whether taken 


from a field manual, ARTEP manual, soldier's manual, or 


decided upon by a group of experienced military judges, must 
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Pemeoalihstic, Consistent with existing doctrine, and made 
Pew tO the evaluated unit. The units must have sufficient 
time prior to the evaluation period to train to achieve 
those standards. The assigned missions, criteria, and their 
associated performance indicators as given in the appendices 
weewoereSUlt OF Che allthor s refinement of composite lists 
from several documents (Refs: 4,6,7,8, and 15). In add- 
ition, research into other experiments conducted by agencies 
such as The Army Research Institute, The Combat Developments 
and Experimentation Command at Fort Ord, California, ORI 
Inc., in Monterey, California, and The Human Resources 
Research Organization, and the author's personal experience 
as an infantry officer were used to develop the appendices. 

Some of the performance indicators require evaluator's 
judgment and thereby aroice a problem of possible 
inconsistency from one evaluator to another. For example, 
what one evaluator may deem as sufficient concentration of 
combat power to overwhelm and destroy the opposing force may 
not be the same for another evaluator and may result in 
different ratings. An example of the quantitative versus 
the subjective evaluations for each level of performance is 
P_emm@ed 11 Chapter IfI. Methods of resolving such problems 
gemaarferences in evaluator s judgments are discussed in 
Chapter V. The subjectivity of the evaluations is related to 
the individuals involved. Consistency between evaluators is 


extremely important, both to the units being evaluated and 
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Bemene  Gadta Collection effort. To attain this consistency, 
merece EnTained, professional, cadre of evaluators such as 
Baese lm the Operations Group at the NTC, would be ideal. 
These evaluators must be aware of the impact which their 
subjective evaluations have on the overall objective and 
must be conscious of the importance of consistency. These 
Factors are necessary to produce a statistically reliable 
evaluation. 

For the most part control over the evaluation will 
result from a well written scenario and the implementation 
of that scenario by the evaluators and controllers. This 
will be part of the training which the evaluators/controll- 
ers will receive. Situations might arise when the unit is 
unable to complete or start a mission by a specified time. 
In such a case the evaluators and controllers must respond 
in order to make the units continue the operations in an 
appropriate manner, such as by issuing a fragmentary order. 
Whatever the means, they must maintain positive control over 
the situation so that the units perform the missions 
designated, the evaluators measure the appropriate 
performance indicators, and the needed data is collected. 
Control is also extended to include the opposing forces by 
tiaternag that they follow the scenario and are responsive 
through their chain of command to the evaluators/controll- 


ems. fi_emewi ll be shown tm ~Chapter IV how the 
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peaeuaters/controllers are assisted in controlling the 
evaluation and even in making evaluation judgments by the 


ieemor instrumentation and other means at the NTC. 


D. EXAMINING PERFORMANCE FOR DEGRADATION 

To examine performance degradations that result from 
continuous operations, baseline data must be compiled on the 
Same performance indicators but without the effects of 
continuous operations. This entails subjecting units to the 
Same scenario and measuring the same performance indicators, 
but doing it one mission at atime in an effort to eliminate 
the effects of continuous operations. The methodology by 
which the eee ne data are compared to the data from 
continuous operations is discussed in Chapter V. 

Data from the continuous operations will be compared to 
the baseline data and examined for any significant 
differences. The result of this analysis will provide 
insight into the differences between performance factors in 
continuous operations versus baseline conditions. Data 
will be maintained to facilitate analyzing individual units, 
units as groups, improvement in training techniques, 
effectiveness of new weapons systems, etc. The better the 
design, planning, and execution of the evaluation, the 
greater the chances that the differences in continuous 
operations performance and baseline performance can be 


determined from analysis of the data. 
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Iitl. PERFORMANCE MEASUREMENTS 


As previously discussed, problems may arise concerning 
the subjective evaluations. In order to effectively conduct 
the analysis, the differences between a quantitative and 
subjective evaluation must first be made evident. ey 
demonstrate this difference, examples of actual performance 
indicators to be measured will be used. As seen in 
Appendices A through D, each performance indicator is 
followed by either a (Q) or an (S) to signify whether that 
indicator is quantitative or subjective in nature. For each 
imembeator that 1S quantitative in nature, the evaluator 
simply records the observed result. There is no latitude for 
the evaluator to make a judgment. In some cases the 
evaluation may merely involve a tally such as the munitions 
expended by number and type, or the percentage of calls for 
fire support acknowledged. The evaluator is assisted in this 
task by a sophisticated system of data collection devices 
discussed in more detail in Chapter IV. 

In the case of the subjective rating, the evaluation 
method is not as clearly defined. FOr ©xamo leva 
performance indicator such as the assessment of the route of 
advance selected is not as definite as counting the number 
of reports submitted. The rating scheme for subjective 


Saoaiaewons and Now #0 make use of them is discussed in 
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Smapter V. It can be seen that this is an area that 


requires a well trained, professional cadre of evaluators. 


Peas veo OF PERFORMANCE INDICATORS 

The following are examples of performance indicators to 
be measured at each level, demonstrating the difference in 
quantitative and subjective type indicators within the 
various missions and criteria. At the command and control 
level would be the S-3 (the operations officer) and his 
staff for evaluation in the operations area. A criterion, 
as found in Appendix A, page 71 , would be "Ability to 
Support the Commander During Operations." The quantitative 
performance indicators to be measured are: 


-- percentage of required or requested reports not 
Submitted (Q) 

-- percentage of required or requested reports not 
Giomitted . on time (0) 

-- percentage of required or requested reports submitted 
that are not accurate (Q) {Ref. 4: p. 5-5] 


At the company level, one of the criteria for the Hasty 


Attack mission, as found in Appendix B, page 77 , is to 


i@omauet a Hasty Attack". The subjective performance 
indicators to be measured for this criterion are: 


-- assessment of ability to eliminate opposing force (S) 

-- assessment of ability to determine opposing force 
strength and disposition (S) 

-- if resistance is assessed to be too great to overcome, 
assessment of request for assistance from higher 
headquarters (S) 

-- assessment of use of indirect fires (S) 

-- assessment of leader's FRAGO to accomplish required 
tasks (S) 

-- assessment of use of cover and concealment (S) 

-- assessment of use of other supporting fires (S) 
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Bmeectoscocment Of ability to consolidate, reorganize and 
Pach aGeCerorcontintic attack once Objective is taken (S) 
=- Situation reports (SITREP) submitted as necessary (S) 
-- assessment of movement techniques (S) (Ref. 4: pp. 5- 
11 - 5-15] 
~oametemorctoon level, as part of ‘the indirect fire support 
mission, several criteria are designated for evaluation 
similar to the following described in Appendix C, page go, 
wimeage jan Agea Target.” 
The quantitative performance indicators to be measured are: 
-- Time it takes until platoon initiates fire for effect 
(FFE) once the target is identified (Q) 
Zoo mstanccmunt volleys are from the target area (Q) 
(Ref. 6: p. 8-41 -4] 
At the individual level the tasks are composed of 
performance indicators of a subjective nature. They will be 
rated in accordance with the system specified in Chapter V. 
For example, one of the performance indicators in the group 
of tasks for the Light Antitank Weapon (LAW) found in 
Appendix D, page 95 , is Ability to Prepare an M72A2 for 


fete Restore M/ZAZ LAW to Carrying Configuration. 


B. EVALUATOR'S GUIDE FOR INDIVIDUAL LEVEL 

Meo —euacon s Guide 1s provided fomstandardize the 
grading at the individual level. Below is an example of such 
a guide for the performance indicator, Ability to Prepare an 


Meeeg for Firing. 


ieeconaucts prefire inspection. 
a. Checks seals to see if intact 
pee che@ies tube for cracks, punctures, or crushing 
c. Checks safety handle to insure it is spring loaded 
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Checks data plate on launcher for the words 
Pv/ coupler” 


e. Tells trainer whether LAW is usable or, if not, 

why it is unusable. 
2. Prepares launcher for firing. 

a. Removes sling assembly 

Deeeewexcenas the LAW until it is locked in position 

c. Places LAW on shoulder with front end of the LAW 
toward target 

d. Checks backblast area before arming the LAW 

e. Arms the LAW while keeping it on the shoulder 

3. Restores launcher to carrying configuration. 

a. Returns trigger handle to SAFE 

b. Grasps launcher by rear sight housing and 
Squeezed detent boot 

c. Collapses launcher slightly 

d. Moves hand from detent boot to front sight 

e. Holds down front sight and collapses launcher 
DMi@iebo Tnmetr Cube covers tip of front sight 

f. Folds down rear sight and guides it under housing 

g. Compresses launcher until travel is stopped by lip 
Soecnone Sight, presses front sight up with thumb 
and slowly compresses launcher over lip edge 

h. Removes thumb from front sight and grasps housing 

i. Closes launcher fully 

3}. Closes rear cover, insuring that the round lock 
Pies emrougi the slot in the cover 

k. Replaces cover pull pin 

1. Replaces front cover and holds in place 

m. Replaces sling assembly by grasping both web 


straps of the sling assembly next to the hook 
Springs and placing thumb on the rear cover above 
the hinge, exerts downward pressure with thumb and 
pulls up on the sling assembly until the hooks 
Snap into position over the cover hinge [Ref. 8: 
p. 3-123] 


The evaluator will use the above guide and rate the soldier 


from poor to superior. Normally these type tasks are scored 


on a Go, 


No-Go basis, but for the purposes of evaluating 


performance degradation the subjective rating scheme 


proposed in Chapter V is used. 
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In summary, this chapter indicates the diverse nature of 
MiceepeLlLormance indicators, criteria, and missions which 
must be evaluated. They represent various levels of 
Peselwelon requirements for their specification, in addition 
to the combination of quantitative and subjective 
evaluations. Before describing the techniques required to 
evaluate these complex interactions (Chapter V), the 
proposed environment for obtaining the needed data is 


described in the next chapter. 
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IV. THE NATIONAL TRAINING CENTER ENVIRONMENT 


ee eee 


mre suitability of the National Training Center (NTC) at 
Meiavim, California, fOr this experiment is discussed in 
this chapter. A facility such as the NTC is a necessity if 
an experiment of this type is to be conducted with a high 
degree of realism and reliability. The objective of the NTC 
nels es 
"Provide a facility where heavy battalion task forces, 
controlling brigade headquarters, and supporting units can 
undergo essential combat arms training that cannot be 
accomplished at home stations due to physical limitations 
puceepmehipbitive cost of providing a realistic training 
ememnomment.” [Ref. 9: p. 1] 
Adhering to that objective, the NTC provides a realistic 
Semiede environment in which training for combat can be 
accomplished, as well as the evaluation of the units that 
undergo training. The evaluations are performed as an aid 
to training so that the units may discover their strengths 
and weaknesses and use the evaluation as a guide to follow- 
on training at their home stations. In some ways the means 
Se valiation by way of data gathering is very 
sophisticated, especially when compared to the home station 
ARTEPs administered and evaluated by sister units. The 


following is a brief overview of the data collection system 


at the NTC. 
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A. NATIONAL TRAINING CENTER INSTRUMENTATION 

The instrumentation system for data collection at the 
NTC is The National Training Center Instrumentation System 
(NTC-IS). Data is generated and collected from live fire 
and force-on-force engagement exercises. mie “data. ais 
collected by instrumentation in the training area, observers 
ea@emecontrollers (0/Cs), video recordings, and monitored 
paceo nets. mine NEC=—§Ss, is composed motmenree major 
subsystems: the Core Instrumentation Subsystem (CIS), the 
Range Monitoring and Control Subsystem (RMCS), and the Range 
Data Measurement Subsystem (RDMS). The RDMS provides real- 
time position location and engagement event data for all 
instrumented players. The RMCS includes automated sensors, 
Video cameras,-and O/C's for the purpose of monitoring and 
@Gomenolling activities within the training area. All data 
Peles gO through the CIS which acts as a computer recording 
center and an operations center for Exercise Management and 
Control teams (EMC) and Training Analysis and Feedback teams 
(TAF). 

Wvewomoe1s the central computer fagility that provides 
all real-time data processing and interactive displays 
Meeessary to monitor, command, control, and evaluate the 
training throughout the exercise area. The RMCS is linked 
Monon cELSes through a visual, audio, and digital 
communications network that provides the means to monitor 


aieeecontrrol activities. Thess DMaeiswalso Janked jco the Cis 
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meeeougm a digital interface component which allows 
transformation of the data to the CIS in a usable form. The 
CIS processes and displays the data as necessary for 
analysis and evaluation. Personnel in the CIS can then 
control the exercise by transmitting messages to the RMCS, 
maersrig Or alding the O/C's in the control of the 
evaluations. The instrumentation utilized at the NTC 
includes the Multiple Integrated Laser Engagement System 
(MILES) for automated casualty assessment. MILES consists 
of varying types of eye-safe lasers which can be fitted to 
most direct fire weapon systems. Players (soldiers, tanks, 
armored personnel carriers, etc) are fitted with sensors 
which detect the strike of a laser beam. Whena player is 
struck by a laser beam, that weapon system is rendered 
iemperative. [{Ref. 10: pp. 27-53] Instrumentation also 
exists to record position location and event occurrences, 
such as weapons’ firings and unit movements, for up to 500 
players. {Ref. 11] The following are examples of how the 
system's instrumentation enhances an evaluation. 

~- Position Location: every instrumented player has his 
location measured every thirty seconds via the RDMS and data 
files are maintained at the CIS. These files allow for 
calculations such as movement distances, movement rates, and 
ranges between players. 

z= Training Area Observations: two large cameras 


Peseroned on mountains overlooking the exercise area and 
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Six mobile video teams combine to Sieuidio was displays to 
MiemoecrsOonnel! in the CIS. Through communication links to 
miemwe,G on the ground, the personnel monitoring the displays 
Stometa the O/C t@ reflect unit and individual movement 
techniques, use of cover and concealment, positioning, etc. 
in his performance assessment. They also aid in control of 
the exercise. 

-- Weapons Firing: when a weapon is fired by an 
instrumented player, the time of firing, identification of 
firer, and firer's location are recorded. Similarly, when a 
Simulated round impacts on or near an instrumented player, 
the time of impact, identification of target, and target's 
location are recorded. The CIS does a pairing between the 
firer and the target and will return a result of engagement 
Semeetag a fit, miss, or kill. The CIS will also tabulate 
Seem intormation as number of rounds of ammunition fired by 
individual weapon system, type weapon, unit, number of enemy 
targets of various types hit and killed, current status of 
hk@empees, etc. 

-- Radio Transmissions: the system has the capability 
to record more than twenty radio nets which will provide a 
Hens O monitor transmissions f£or correct procedures, 
Suemalesecurity, electronic warfare actions, etc., as well 
as a means to check key events. 

mbluecdata 1s recorded in the CIS in sufEicient detail so 


that each training element's operations can be examined as a 
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memorate entity down to the individual firing platforms. 
iiemacdata Can also be aggregated to produce battalion level 
Peeestlcs LO assist in overall unit assessment. The use of 
equipment such as MILES devices further allows examination 
pemesmpport elements in that a firing platform may be 
disabled by a controller's key and unable to fire. The 
controller may return the platform to action only when the 
proper maintenance or supply functions have been completed, 
thus forcing the real-time play of these activities. (Ref. 


Ose. 27 ] 


B. ADVANTAGES OF THE NATIONAL TRAINING CENTER 

Memers obvious that the instrumentation at the NTC 
provides a Significant improvement over evaluations done at 
a normal training post. In addition to the instrumentation, 
there are other major advantages such as the trained cadre 
of observers/controllers who are assigned to the units down 
to platoon level, and the dedicated opposing force (OPFOR) 
personnel. The cadre of O/C's offer a degree of consistency 
and confidence of replication of the exercises that could 
never be attained at a unit's home station. The OPFOR also 
provides a degree of consistency, the realism and needed 
combat learning that the units being trained require. The 
[/meenerumentation, cadre of observers/controllers, and 
dedicated OPFOR offer precisely what the evaluation for 


performance degradation demands: accuracy, consistency, and 
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realism. Only under these conditions can the data needed 
for such an evaluation be reliable. 

Many of the performance indicators that need to be 
measured for the evaluation of performance degradation are 
already being measured as a unit progresses through its 
eeemming at the NTC. ft would “appear wiehat minima | 
additional resources would be required to provide the needed 
data for an evaluation of performance degradation as 
proposed. Wao PrOhtbitiEnvye Costs of Settang up an NTC 
environment at home stations, especially in terms of 
manpower and money, dictates the use of the NTC for such an 
evoeuarion., While some disruption may occur to fit such an 
SeuatlLon into the NTC, fees fan fOUlE wel gmed. by “Ene 
meee aability of data and the conclusions of any data 
analysis accomplished with lesser resources. The importance 
of discovering, examining, and compensating for performance 
aemmacdation due to continuous operations must be realized 
and given the appropriate attention in terms of training and 


planning considerations. 
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V. EVALUATING PERFORMANCE AND THE MEASUREMENT OF DEGRADATION 


A. OVERVIEW 

An overview of the evaluation system is given to outline 
the procedures for evaluating performance and for measuring 
performance degradation, after which the details of the 
system are described. At the outset it must be understood 
that several years will be required to conduct unit 
evaluations that will provide sufficient data needed to 
conduct the statistical analysis being proposed. The type 
units to be evaluated will fall into one of four categories: 
light infantry battalions, mechanized infantry battalions, 
armor heavy task forces, and mechanized infantry task 
Forces. Units will be compared only to units of a similar 
type when investigating performance degradation. 

There are certain requirements that the units must meet 
before they are allowed to conduct training at the National 
iealming Center. They must, for example, pass the Army 
Training and Evaluation Program (ARTEP) given at their home 
stations. They must also have achieved a certain readiness 
level in terms of equipment serviceability, training, and 
personnel. These prerequisites are designed to act as a 
screening device to prevent wasting time and resources on 
(memes = that are not prepared to conduct training. These 


prerequisites will also be used to eliminate units from 
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taking part in the evaluation whose low readiness posture 
hemmea Dias the results of the evaluation and the data 


analysis. 


Eee ete ito OF MEASUREMENT SCALES 

As mentioned earlier, the data to be collected will 
either be of a quantitative or a subjective nature. As 
such, the measurement scales used in scoring during the 
evaluation are different. Before discussing the differences 
between the quantitative and subjective data forms and how 
they will be analyzed, a review of the four types of 
measurement scales is presented. The first and weakest of 
the measurement scales is the nominal scale. This scale 
uses numbers ae names for the purpose of categorizing 
elements or separating them into classes. The number or 
name is assigned by convention and serves as only a title 
for the category of observations, such as a one for a head 
aumemea Zero for a tail for the results of a coin toss. 

The ordinal scale is a measurement scale whereby the 
value of the measurement is used only as a means of 
arranging the elements being measured. In other words this 
Seale refers to measurements where only comparative 
relationships between elements are relevant. This would be 
the case when "greater than", "less than", or “equal to" 


measurements are appropriate. 
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The interval scale considers the relative order of the 
measurements and also the size of the interval between 
measurements. This scale involves the concept of a unit 
distance, such as a degree on a thermometer, where the 
actual numerical value of the temperature is merely a 
comparison with an arbitrary point called "zero degrees”. 

Mresitourth scale, the patio scale, utilizes the order, 
interval size, and ratio between two measurements. The only 
difference between this scale and the interval scale is that 
the ratio scale has a natural measurement called zero, such 
as a height, a weight, a distance, or a measurement of time. 


[Ref. 12: pp. 64-66] 


C. ANALYSIS OF QUANTITATIVE DATA 

The quantitative performance indicators are measured on 
a ratio scale. Performance indicators of this type, such as 
emewnumoer Of hits, or the amount of ammunition fired, for 
example, will be analyzed as follows. The data collectors 
described in Chapter IV will submit the scores to an 
analysis group who will record the data for later use in 
determining whether or not degradation has occurred. The 
aaoesis group will employ appropriate statistical tests 
which will be explained later. In order to use such tests 
as the T-test or Analysis of Variance, the data must be 
normally distributed and groups of data being compared must 


have a common variance. Therefore, when sufficient numbers 
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Sra Particular type of unit have been EGvalUated, their 
scores are pooied and the sample mean and sample variance 


computed as follows: 


Nn 
1=1 
Tl 
So ae ic, (2) 


The next step is to check the data for each performance 
indicator and type unit to see if they are normally distrib- 
uted. This is accomplished using the Kolmogorov Goodness- 
of-Fit Test. Appendix F contains an example of the use of 
mies test. If the hypothesis that the data are normally 
distributed is rejected, appropriate transformations to 
normalize the data will be investigated. The use of a 
computerized version of normal probability paper to choose 
@memeoest transformation may be very helpful in this 
endeavor. Some transformations and their effects are shown 
“mommpexamples in Figure 1. An example of the use of 
transformations is given in Appendix F., 

Once the data are determined to be normally distributed 
eumameer the data are transformed, a test must be conducted 
to check for homogeneity of variance between the baseline 
and the continuous operations data for a particular type of 


unit. An F-test will be used to compare the variances of 
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Transformed Distributions 
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Normalizing Effect of Some Frequently Used 


So 20-3 | 





the two normal populations. Appendix F contains an example 
of the use of this test. 

If the hypothesis that the two groups of data have a 
common variance is rejected, a variance stabilizing 
transformation will be used to attain variance homogeneity. 
Some of these transformations and their effects are shown as 
examples in Figure 2. If it is necessary to use a variance 
stabilizing transformation, the transformed data must be 
rechecked to insure it is still normally distributed. Often 
times, however, a variance stabilizing transformation will 
improve the normality of the data. 

Once the data satisfy the requirements for a normal 
distribution and a common variance, the T-test will be used 
to check for degradation. Using the data below, which has 
been checked for normality and a common tee rice as 
explained in Appendix F, an example is given to demonstrate 
the use of the T-test. 

The results of the evaluation of the performance 
indicator, "Time from attack until objective seized" are 
given in Table I for baseline and continuous operations. 
The procedure will test the hypothesis 
Ho? Hcg = Hgy vs 41? Meco # Met. 

A significance level, @, is chosen for the test ( Y= 
.05 is used for this example). The value for Cy _o/2s LOT 
the appropriate degrees of freedom is determined from a t- 


distribution table. For this example the degrees of freedom 
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Panel 


(1) 





Dependence of the variances of two functions of a sample 
value X from a Poisson distribution on the Poisson 


parameter, m. (1) Variance of V ne ; (2) Variance of 
1 —_ eee 
e\VX4+VXFi- 


Panel 


(3) 





Dependenceof the variancesof three functions of a sample 
proportion X/n on the population proportion p when 
the sample size is 10. (1) 40 Var (X/n); 


(2) 40 Var (sin~! /X/n) ; (3) 40 Var (y,) , where 
sin“! 1/4 n for X = 0 
yg, =<sin-' /X/n for X =1,2,...,2—-1 


sin! (4 n —1)/4nforX =n 


Panel 


(3) 


e = 
~~ 


Dependence of the variance of the sample correlation 
coefficient r and of the variance of the transformation 
7s! l1+r 
Zs 5 log G i 

for sample swzen =5. 
(2) Variance of r. 





on the true correlation coefficient p 


(1) Variance of 2’ ; 


Figure 2. 
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3 e = 2uanes a 3 & 


The ratio vf the variance of log.s? to its approximate 
value 2/(n — 1) in samples of size n from a normal 
distribution. 


Panel 


(4) 





Dependence of the variancesof three functions of a sample 
proportion X/n on the population proportion p when 
the sample size is 20. (1) 80 Var (X/n); 

(2) 80 Var (sin-'! VV X/n) ; (3) 80 Var (p,), where 


joan V1/4nfor X =0 
Vumeesine S70 /Ri0r 4 mle 2... , k= | 
tee V(4n—1)/4nforX =n 





Panel 


(6) 





Dependence of the variance of the sample correlation 

coefficient r and of the variance of the transformation 
ie ; : 

27 = dog G zs “) on the true correlation coefficient p 

for sample swzen = 11. 

(2) Variance of r. 





(1) Variance of z’ ; 


Variance-stabilizing Effect of Some Frequently 
Used Transformations. 
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Table I. Times From Attack Until Objective Seized 
(in Minutes) 


meee ee —_—— =——— —- ws 


Baseline Cone lImuouswopetTat1ONs 
ey2 76! 
om 57 
| ayy 15 2 
| 152 148 
| 164 56 
| 159 
164 
See ela, + Neco - 2 = tO me efor tens degrees of freedom, 


t 975 = 2.228. Computing Xpr, and Sen Xag and Sea rom 


iitfem@ata in Table I yields xp, = 165, 


Zoe ae 7 
SB, 3 134, XCO = 
ipoe2, and Sees =" 2:0 The pooled unbiased estimate for 


the standard deviation, JO, is then computed: 


LL Le, = ae ae 
ao /(pi-1) Spr + (Neo-1) Seco 63) 
; V Np + [co - 2. 


For the example this is 


6(134) + 4(26.7) 





/ 
Ss eee = -\/ 91-08 = 9,544, 
10 


iWewce=statistic is then defined as 
2 CO 
Lt 


C4 y/2 a . (4) 
Beco 


For this example 


12 
ae 
BD 


KF 
il 


212264 (5050) = 12.45 


45 





If the difference in the means Xpr, - Xco|is greater 
than T, the decision is that the average scores of the 
baseline units differ from the average scores of the units 
under continuous operations; otherwise, the decision is that 
there is insufficient reason to believe that the average of 
the baseline units differs from the average of the 
SComeunneus operations units (i.e., Hog cannot be rejected). 
Returning to the example, 


=e Oy 


Xpr, - Xco = hes-155.2 











mame weis not larger than T = 12.45. There is no reason to 
believe therefore, that the baseline units' performance 
differs from the performance of the units under continuous 
operations. in offer words, nOpsigniticant degradation was 
observed for this performance indicator and Hp: Meg =Mpy, 
would not be rejected. If the test results showed that the 
average score for baseline units differed from the average 
score for units under continuous operations then it would be 
said that a difference in performance had occurred and 
Hy: Mao = MK op would be rejected. [Ref. 13: p. 3-34] 

if Hy is rejected, the mean scores would then be 
compared to obtain a percent difference in performance. 
This percentage would be recorded as the percentage that 
this particular performance indicator differed between the 
EWwor Conditions. This procedure will be described later in 


the chapter. All quantitative (ratio scale) performance 


46 





indicators will be evaluated in this manner to determine 
those that show a significant difference in performance. 

When the four different types of units have been 
evaluated for a particular performance indicator using the 
T-test, an ANOVA will be used to further investigate the 
degradation phenomenon. The ANOVA will reveal whether or 
not there is a significant difference in the way continuous 
operations affect the different types of units. This offers 
the potential to investigate which units might be best 
suited for certain missions. Before the ANOVA can be used, 
however, a check for common variance must be made between 
the groups of data. Because there are more than two types 
of units being evaluated, Bartlett's Test (a test for 
comparing more than two normal populations for homogeneity 
of variance) will be used. An example of the use of 
Bartlett's Test is contained in Appendix F. 

When the data are found to have a homogeneous variance 
or after the data are transformed so that there is a 
homogeneous variance, an ANOVA will be used. The following 
is an example to demonstrate its use. The numbers in Table 
II represent the mean scores for each type unit for one 
Poteteular performance indicator. Using the data in Table 
Il and making the necessary computations, the two-way 


analysis of variance is given in Table III. 
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Table II. Mean Number of Targets Not Engaged at Least Once. 
ne Cai ces fae ioe gs a ye cto eee ns A ay 


Rees ONT T 
Perght Mechanized Mechanized Armor Heavy 
Infantry imt amery Ibsglames gle sans Task Force 
Battalion Battalion Task Force 
Condition (1) (2) : selon) (4) 
Baseline 24 16 14 18 
fMeoneinuous 
(Operations 30 18 18 22 





oe ee eee eee i ee a ee me ee — 


Table III. ANOVA Table for Mean Number of Targets Not 
Engaged at Least Once. 


f 


| 
Pearce Freedom Squares squares 


Degrees of Sums of Mean 
'Average 1 3200 3200 
/Condition 1 SZ BZ 
wie Unit 3 148 497.28 
|Residual 3 4 ie 
| Total 8 3384 


The F-test is used to test the hypotheses 
Ho? Kay = Keo 


H,: Mer, + Keo 


The computation is as follows for the "condition" source: 


i 


MSC/MSR = 32/1.33 = 24.1 which exceeds F 95 = 10.12 with 1 
and 3 degrees of freedom. Therefore, the null hypothesis is 
memgieemwed with (Y = .05. From the same analysis of variance 
it is possible to test the hypothesis that the effects of 
continuous operations are equal for the four different type 


units. Performing the computations, 49.33/1.33 = 37.10 and 


Sepanimg this result to F 94 for 3 and 3 degrees Ga 
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meeeaOm, 1€ 1S evident that 37.10 exceeds 9.27. Therefore, 
the hypothesis Eire sea =, =H, ieee jected: wi tie = 
Peeeeeec tac alternate hypothesis H,: at least one of the 
means 1s different, is accepted. [Ref. 14: pp. 502-503) 

One may wish to further investigate why the units were 
not all affected in the same way. AMcies Sie fg erm ie lp rs lap ata’ g 
battalion data may be excluded from the analysis and the 
other type units checked for equal effects, for example. If 
this subsequent analysis reveals the units are equally 
affected, more investigation may be warranted for the light 
imicmery battalion fEor this particular performance 
indicator. Perhaps a difference occurred because this type 
unit is not as mobile as the others, or because they ae i 
armor protection. This 1s used merely as an example of one 
of the many ways the ANOVA can be used to aid in the 


analysis process. 


D. ANALYSIS OF SUBJECTIVE DATA 

The subjective data will be considered ina somewhat 
different manner. The evaluations of subjective performance 
iremedtars are difficult to make on an interval or ratio 
scale while maintaining the needed consistency between 
evaluations and between evaluators. A more common approach 
tomeco = classify subjective performance indicators into 
categories such as poor, below average, average, above 


average, and superior; or ineffective, slightly ineffective, 
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effective, highly effective and extremely effective etc. To 
aid in consistency and assist the evaluator with his rating 
task, there are cea descriptors associated with each 
category. For this evaluation system the categories; poor, 
below average, average, above average, and superior will be 
used. The descriptors for these categories are as follows. 
The poor rating will be given to signify that the unit 
or individual being evaluated did not successfully complete 
the assigned task. This may be due to excessive time taken 
EOmDeiEerm a task, a violation of doctrinal procedures, 
failure to achieve a specific requirement, or some other 
shortcoming warranting an unsatisfactory performance rating. 
The below average rating will be given to a unit or 
individual that did not successfully accomplish the assigned 
mission, but showed some signs of effectiveness during the 
mPiltiat ion: The average rating will be given to the unit or 
individual that completed the mission or task with marginal 
Suieeescsc, but performance could still be significantly 
improved. The rating of above average will signify that the 
unit or individual successfully completed the assigned 
mission or task and showed during the evaluation that in 
some areas they exceeded normal requirements and 
performance. Finally, the superior rating will be given to 
those units or individuals who completed all requirements 
and who performed as well as could be expected of any unit 


Gapeindividual. 
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The approach for the subjective performance indicators 
fom Utilize these categorical ratings with numbers 
associated with each rating. A poor rating will receivea 
Five, a below average rating a four, an average rating a 
three, an above average rating a two, and a superior rating 
aone. The results of the evaluation will be submitted to 
the analysis group who will review the ratings for a 
determination of differences in performance. The evaluators 
will rate the units’ performance on a nominal scale, while 
the analysis group, through use of the associated numbering 
system, will convert the ratings to an interval scale as 
described above. Each performance indicator will be 
evaluated for differences in performances using the same 
statistical PRoOceGuUEecm@esc sho ed moO ele wnat te@ sca he mdarans 
The approaches differ in that instead of a determination 
Emre a Gitference in performance has occurred and 
subsequently obtaining a ratio scale measurement of the 
amount of degradation for the quantitative performance 
indicators, the subjective performance indicators can be 
measured only in terms of intervals. 

Up to this point the procedures have been explained for 
Gata that are normally distributed or can be transformed to 
Paea normal distribution. If data for a performance 
iiterecasor is not normally distributed and cannot be 
Emeiertormea to fit a normal distribution, its distribution 


mast be identified. Graphing the data will assist in 


51 





frMvelrying the distribution and then the Kolmogorov's 
Goodness-of-Fit Test will be used to accept or reject the 
hypothesized distribution. Once the distribution has been 
identified, appropriate procedures can be developed, based 
on the distributional assumptions, to analyze the data. 
[wat ter attempting to identify the probability 
Mismeaetouwelon of the data for a performance indicator, a 
distribution cannot be found, nonparametric procedures are 
required for the analysis of the data. These procedures 
generally make fewer assumptions about the underlying 
probability law and thus can be expected to perform quite 
well over a spectrum of possible distributions. [Ref. 14: 
p. 508] This greater generality however, is achieved at the 
price of somewhat reduced discriminating power when 
assumptions about the distribution and variability of the 
Poplbrearions cannot be made. [Ref. 13: p. 3-3] In short, if 
one is confident that the sample actually came from the 
assumed probability distribution, parametric tests should be 
used because they take advantage of the known distribution 
to give more specific information. If one is not confident 
Saas Kriowledge of the underlying distribution, then 
nonparametric tests should be used rather than using 
parameters that may be incorrect, thereby yielding results 
that are suspect. Nonparametric tests such as the Squared 
Reese Dest for Variances to check for homogeneity of 


variances and the Mann-Whitney Test to check for equal means 
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between populations would be used to test for whether 
degradation occurs between baseline and continuous 
Operations. The determination of the amount of degradation 


tsenot affected. 


E. ANALYSIS OF THE AMOUNT OF DEGRADATION 

Once all the performance indicators have been evaluated 
as described above, the analysis is focused on measurement 
of the amount of degradation that occurred. For reasons 
that will soon become evident, the performance indicators 
will be organized into groups according to the criterion 
they constitute (See Appendices A through D). This will 
allow further examination of the performance indicators as a 
group to determine how much a criterion differed in 
performance between baseline and continuous operations. 
Further aggregating these criteria into groups that make up 
miemmmisstons will permit examining the missions for 
differences in performance. 

Up to this point the performance indicators have been 
examined on an individual basis. The first thing that must 
be done when the performance indicators are aggregated into 
groups is that weights must be assigned to each of the 
performance indicators within each of the criteria, the sum 
of the weights for a certain criterion being equal to one. 
These weights are a reflection of a group's consensus as to 


the relative importance of each performance indicator to its 


5 





respective criterion. 


or another designated body of military experts. 


That group may be the analysis group 


The weights 


will be decided upon before the evaluation begins and will 


memaLtn f£ixed. 


Table IV is a sample format for the analysis 


Reet~mtO USC aS an ald in consolidating the results of an 


eeamtiideten £LOr a particular criterion for one type of unit. 


Criterion: 


Performance Indicators 


- 


} 2 2 


perLOormance indicators, 


Table IV. 


Time to Report 
Target Location a2 


Percent of Reported 
Targets not Assigned 
for Attack ol 


Time From Report of 
hapget Location Until 
Rosrameece tor Attack .2 


Time From Target 


Assignment Until 
Target Attacked So 


a oe ee 


Meterring to the T-test results 


Continuous 
Baseline Operations 
Score Score 
TOA, 


a my tes ee en te ee ene ee 


of each of 


a significant difference between performances, 


performance difference, PD, 1s calculated. 


Table V, 


Sdllple: !onmat tor Consolidating Resultsi = 7. 


Interdiction Target Assignment (Quantitative) 


ee 


the 


if it was determined that there was 


the 


As an example, 


using the same criterion and performance indicators 


from Table IV, demonstrates how to evaluate the performance 
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Table V. Example of Calculating Performance Difference. 


Pogson s interdiction Target Assignment (Quantitative) 





| Cone taueus 
| Baseline Operations 
Performance Indicators WT score =ceqge PD WTxPD 
me Eime to Report 
Target Location a 75 100 33s eeooe 
fe erercent of Reported (Not Signi-| 
! Targets not Assigned fFicant) 
| for Attack a4 oe Ca 0.0 G0 | 
3, Time From Report of 
: Target Location Until 
| Assigned for Attack .2 ez 0 110 OC W201 
4. Time From Target 

Assignment Until 

Target Attacked 2 liye 22 =. 2360 — 2 lls 

TOTAL =, 165 


a ae 
PemeatiGrs and the criterion. Performance Indicator 1, Time 


to Report Target Location, was Fee aed by the T-test to 
have a significant difference between baseline and 
continuous operations performances. Suppose under baseline 
conditions the mean score for this type unit was 75 seconds 
and for continuous operations the score was 100 seconds. It 
should be noted that all performance indicators are 
constructed so that the higher the score the poorer the 
Bemtormance (i1.e., bigger is worse). 
The convention for computing the ratio is, 
BL - CO 


PD = ————- (5) 
BL, 


De 











where, 

PD is the performance difference, 

BL is the baseline score, and 

CO is the continuous operations score. 

Thus, a positive number indicates a significantly better 
performance in continuous operations than in baseline. For 
example, consider performance indicator 1 (PI-1) in Table V; 
the performance difference, PD, is calculated using equation 
eSyedisn (75 - 100)/75 = -0.333, interpreted as PI-1 is 
degraded by 33.3% in continuous operations. For PI-3 the T- 
test determined that there was a significant difference in 
performance and it happened that performance under 
continuous operations was better than the baseline 
performance. For example, the mean continuous operations 
score was 110 seconds and the mean baseline was 120 seconds. 
Therefore the difference in performance is calculated as 
roe 110)/120 = 0.083, interpreted as an 8.3% improvement 
in performance for PI-3. 

If it was determined that there was no significant 
difference between baseline and continuous operations for a 
performance indicator for one type unit, a zero is placed in 
the performance difference (PD) column for that performance 
Hees a. tr. For this same criterion, the T-test for PI-2 
showed no significant difference in performance, so a 0.0 is 
placed in the PD column. 

This procedure is repeated for each performance 


iie@dieator, Lor all the criteria. When the procedure is 
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completed for a criterion, as in Table V, the weights of the 
performance indicators, multiplied by the difference in 
performance, will be summed to give the APE ovenes oty3a) 
performances for the criterion. As shown in Table V, the 
summation of the weights multiplied by the difference in 
performance indicates that there is a difference in 
performance of -.165 (i.e., this criterion is degraded 16.5% 
Pyeconetmuous operations). 

The differences in performance for the criteria are then 
carried forward when the quantitative criteria are 
aggregated into groups for the purpose of examining 
differences in performance at the mission level. Table VI 
is an example of this procedure which is done in the same 
manner as the aggregation at the criterion level. As seen 
Mimtarole VI, the -.165 just calculated for the criterion, 
Interdiction Target Assignment, has been carried forward in 
miemeD COLUMN of criterion 4. Peer omeinec huded hate he 
ealewlations to determine the difference in performance for 
the mission, which as noted, is -.051 or degraded by 5.1%. 

A similar process will be used for the subjective 
performance indicators, except that the measurement of 
difference in performances will be on an interval scale. 
The performance indicators are constructed so that there is 
no mixing of subjective and quantitative performance 


indicators within the same criterion, thus avoiding the 


ah 





problem 


of 


adding measurements 


Measurement scales. 


Table VI. 


Quantitative Data. 





Level of Interest: 


from twormeraqaltErerent 


Example of Aggregation at the Mission Level for 


ee eee - 


Battalion Command and Control 


Mission: Provide Indirect Fire Support (Quantitative) 
Criteria WT PD WTXPD 
1. Fire Support Target | 
AeGursittion and 
Assignment to Direct 
| Fire Battle oe 0 020 
2. Fire Support 
| Effectiveness Be ~43 0.086 
3. Interdiction Target | 
| Acquisition 1 -.60 -0.060 , 
| 
Peeeeaccrdiction Target | 
| Assignment zi -.165 = Oe Only 
5.  Interdiction Target | 
Attack Effectiveness a2 aS Or050., 
6. Counterfire Target 
Acquisition sail 0 OFS 10, 
Wemeerhicient Use of Fire i 
Support Systems Pe =455 —0, 110% 
TOTAL -0.051 | 


Table VII shows an example of the aggregation of 


Subjective performance indicators at the criterion level and 


an interval measurement of the difference in performances. 


As the table indicates there was no significant differences 


in performance for performance indicators 1, 2, and 4. 


As 


was done previously, a zero is placed in the PD column for 
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Table VII. Example of Aggregation at the Criteria Level 
fOr SUDIJecElVe Data: 


Criterion: Locate Opposing Force (Subjective) 








Continuous 
Baseline Operations 
Performance Indicators WT Seene score PD we De 
| 
(Not eHeni =| 
1. Assessment of Eicant >) | 
Movement Techniques .2 2 Jae OO ne 0 | 
25 JUS se seynleiie (ee Uists Cieiby sLamy 
of Cover and hilecant ) 
Concealment ee 3.4 S03 ORO, . Oe) 
3. Assessment of | 
Site Selection Zo eS 20 -0.8 ro 
4. Assessment Use (Not Signi- 
of Visual Signals Piece mite) | 
tomecontrol Movement .3 a. | 320 O20 OR | 
TOTAL -.24 





mm rm cr ec eg, ee eee ee 


those performance indicators that did not demonstrate a 
Set Peaneeait ference in performance. For this example, 
assume the T-test did determine that there was a significant 
difference for performance indicator 3. The mean baseline 
score was 1.5 on the interval scale, while the mean 
continuous operations score was 2.3. If the same technique 
is applied as before, the difference in performance would be 
(1.5 - 2.3)/1.5 = -.53, interpreted as PI-3 was degraded 533 
Dimes tmuousmOoDerAaALIONS. Jihis precedure is not correct 
Slee e 1S inappropriate to compute percent differences on 
tiem dirscalea Gata. The correct method is to conclude 


that the difference between performance is 1.5 - 2.3 = -0.8, 


ag 





interpreted as being a decrease in performance of .8 of an 
interval. The interpretation of this difference is more 
subjective than when actual percent differences are 
Gemmpmted from the ratio scale data. Tie reswees are 
reflected in Table VII and the criterion is shown to be 
degraded .24 of an interval. 

These calculations are shown to emphasize the difference 
in the measurement scales and their impact on the results. 
The analyst must keep in mind the difference between the 
quantitative and subjective data and realize that the 
numbers are not to be interpreted in the same way. 

Recalling the quantitative criteria in Table VI that 
were aggregated for the purpose of examining performance at 
Memo sstom level, those missions comprised only of 
subjective criteria are analyzed in the same manner. Table 
VIII is an example of this procedure for the scout platoon's 
Mission, Zene Recenmalssancems which is made up only of 
Suboueemive Griteria. Asi seenpeehe -.24 calculated for the 
criterion, Locate Opposing Force, has been carried forward 
Paemelambe Vit and placed in the PD column of criterion 3 in 
Tale VIII. It is mmcluded@win the calculations to determine 
the difference in performance for the mission which is 0.299 
or interpreted as performance improved in continuous 


operations by 0.3 of an interval. 
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Ragte VIII. Example of Aggregation at the Mission Level 
for Subjective Data. 


ER SN 





Level of Interest: Specialized Platoons 
Mission: Zone Reconnaissance (Subjective) 


Sewaeerla Wt PE WTxXPD 
(Not Signi-. 
1. Plan and Prepare a £ELCame) | 
Zone Reconnaissance we 0 O30 
2. Deploy Teams a ~1.05 -0.105 ! 
3. Locate Opposing | 
Force 2 - .24 -0.048 | 
4. Develop the Situation a2 os 0.264 
pew collection of Terrain | 
Specific Information =e ~94 0.188 | 
(Not Signi- 
ficant) 
6. Occupy an Assembly Area el 0 0.0 


TOTAL Orc o9 





F. MISSION AGGREGATION~-MIXED DATA TYPES 

Thus far, the aggregation of results has been discussed 
at the criterion and mission levels when the data have been 
either all quantitative or all subjective. As mentioned 
earlier, mixing of the two types of performance indicators 
that make up a criterion was avoided, thereby presenting no 
problem relating to mixing measurement scales when 
aggregating at the criterion level. While examples were 
Seem tror agqqregating at the mission level for those 
missions constructed of all one type criterion, there are 


missions of a mixed nature, in which some of the criteria 
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making up a mission are measured ona ratio scale and some 
are measured on an interval scale. Table IX is an example 
of such a mission. Criteria 1 and 2 are subjective criteria 
with performance differences measured on an interval scale 
emcee rireria 3 and 4 are quantitative criteria with 
performance differences measured on a ratio scale. The 
procedures for determining the performance differences are 
the same as described earlier for the subjective and 


quantitative criteria. 


Table IX. Example of Aggregation of a Mixed.Mission. 


Level of Interest: Rifle Companies 
Mission: Deliberate Night Attack (Mixed) 





Simeon ia wn PB WTXPD 





1. Prepare to Attack ae - .6 - .12 
12. Conduct the Attack 52 ale? ae 
{(S) TOTAL eo 
ieee ADility to Acquire 
and Destroy Targets eo =e - .06 
(Not Signi- 
4. Ability to Seize ficant) 
and Hold Terrain LS 0 0 
(OQ), TOTAL -.06 


od 





a ere ee i a er et 





Aggregating the criteria for this type mission is 
different however, in that the mission results in two 
measures of performance differences instead of one. As seen 


in Table IX, the subjective criteria were degraded -.36 of 
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Heiter val 1m COMeEINUCUS Operations and the quantitative 
criteria were degraded by -.06 or 6% in continuous 
operations. Independently, these results are interpreted as 
before, but they must be considered together to evaluate the 
mission. To do this the analysis group makes a subjective 
judgment as to how the two results relate to the overall 
mission. In this example, for instance, the mission is 
degraded at least 6% since the quantitative criteria are 
degraded that much and the subjective criteria are also 
degraded. How much more the mission is degraded depends on 
the subjective judgment of the analysis group. Either 
Segotettly or implicitly, the group establishes a 
relationship between a percentage of degradation and an 
interval of degradation. If, for example, one tenth of an 
interval egquates to .025 or 2.5% on the ratio scale, the 
Subjective result for this mission overall would be that it 
is degraded an additional 9% for a total degradation of 15%. 
It must be noted that this is based on a subjective judgment 
or the relative comparison between percent difference and 


interval difference. 


GG. SUMMARY 

The analysis methodology for the evaluation system 
provides for measurement of the amount of performance 
difference between baseline and sustained operations (with 


the exception of missions which are an aggregate of 
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quantitative and subjective criteria). It is essential that 
any evaluation system which may be implemented assure that 
all steps of the process described in this chapter be 


accomplished to assure ‘statistically viable results. 
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VI. USE OF ANALYSIS RESULTS 


When all performance indicators, criteria, and missions 
have been evaluated and measurements of performance 
differences noted, the results are of three types. 

is The quantitative performance indicators lead to 
ratio scale measurements of performance differences at the 
performance indicator level, the criterion level, and the 
mission level in that percent differences in performances 
are derived. These results can be used in different ways. 

First, they can be useful in combat simulations to take 
into account real performance differences for units that 
have been in continuous operations for a similar time period 
modelled. For instance, if a performance indicator, Such as 
time to engage a eaeveee with indirect fire, has shown 
through the evaluation to be degraded by thirty percent in 
continuous operations, this fact can be reflected in the 
Simulation. The thirty percent may translate to a real time 
difference of one minute; thus in the simulation, responses 
to calls for fire will be delayed by one minute. Secondly, 
at the mission level, a result of fifty percent degradation 
for the hasty attack would mean the effectiveness is cut in 
half and the game would be so modified to reflect the 
a@eqradation by reducing the probability of success such as 


in an aggregated model involving large units. 
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In general, Table X depicts the relationship that might 
exist between the different levels of models and the factors 
measured during the evaluation, particularly for the 


battalion command and control level. 


Table X. Use of Evaluation Factors in Models. 


Model Date Saze Use of Factors 
‘High Resolution Battalion Performance 

| an below Indicators 

| Brigade and Criteria 

| Division 

| 

‘Low Resolution Theatre Level Missions 





Finally, the results could also be used to indicate the 
Paice Lomwork§neeas tegbe done by the units in terms of 
EReeemainG.. In addition, training methods could be designed 
and implemented to compensate for noted performance 
deficiencies due to continuous operations. 

2 The interval scaled data is obtained from the 
Subjective performance indicators, criteria, and missions. 
They are of use in some of the same ways as the ratio scaled 
data. Even though percentage differences cannot be 
Setm@eneeeyeschese Indicators, Criteria, and missions can point 
out areas where attention needs to be focused. An analysis 
Group predetermines, for example, that a performance 
PiCmGeseet, CGEalterion, Or mission with an interval scale 
cmamge OL 0-5 Or Greater is to be noted and brought to the 


ae teteniwa: cheslnit chain Of commana as an area in need of 
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improvement. me aleo May Wareant investigation into these 
areas by the Army's training centers and schools to find 
ways of compensating for the unacceptable performance 
degradation. 

3. The subjective judgment is based on the mixture of 
ratio scaled data and interval scaled data. These judgments 
are required at the mission level and are made only for 
those missions comprised of a mixture of quantitative and 
subjective data. Their use is Similar to those in item 2 
above. Depending on the confidence placed in the group of 
military experts making the subjective judgments which link 
the ratio and interval scaled results, these judgments may 
be suitable for use in models in the same manner as the 
quantitative results. 

The three types of results offer an advantage that is 
not usually available to a user of performance data in this 
type of an evaluation. They offer an audit trail whereby 
one can find out why a certain number is being used for a 
parameter. Suppose, for example, interest is generated as 
to why the mission, Provide Indirect Fire Support, is said 
to be degraded 5.1%. The criteria for that mission are 
listed in Table VI along with the recorded performance 
Gewtecitemcess The Criteria In turn, are listed in other 
tables such as Table V, where the performance indicators are 
listed with their respective scores and performance 


differences. Thus, the audit will reveal the causes of the 
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parameter differences. icemethicatlon of the degraded 
performance indicators and their scores tells not only why a 
mission was degraded, but allows attention to be focused on 
those deficient performance indicators in terms of training. 
By modifying training techniques to improve the performance 
indicators, enhanced performance at the mission level may be 
realized. 

Some of the uses of the results have been mentioned 
above, but they are by no means the exclusive uses of the 
results. The fact that they can be used in computer 
Simulations makes them important in research areas such as 
the effects of new equipment on tactics, strategies, and 
Deere Veoememniose FaActOuomcanealso be investigated using the 
results as parameters in models. fay lou lMportant to 
realize however, that caution must be used in applying the 
results to insure that they are applied Boone ri abales Oi 
example, 1f£f the results are of an evaluation conducted at 
the NTC, they may not be usable as parameters for battle 
Simulations ina jungle or arctic environment. They also 
may not be suitable to apply to an investigation of units 
dissimilar to those used in the evaluation. Used 
appropriately, of course, the results can be employed for a 


myriad of investigative purposes. 
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APPENDIX A 


Level of Interest: Battalion Command and Control 


MISSION: COMMAND AND CONTROL 


Criterion: Commander's Perception of Status of Friendly 


Elements. 


Performance Indicators: 


Manor loneOr SumitEeed reports of location of 
elements which are not accurate (Q) 


Proportion of submitted reports of strength of forces 
which are not accurate (Q) 


PeQworeron sot —SUbmaerea reports of activities of 
elements which are not accurate (Q) 


Proportion of required/requested reports of friendly 
elements status not submitted (Q) 


Criterion: Commander's Perception of Status of Threat 


Forces 


Pereermnance @md@icators: 


Proportion of submitted reports of location of threat 
forces which are not accurate (Q) 


Pespeimeron GE Submitted reports of activities of 
threat forces which are not accurate (Q) 


Proportion of submitted reports of strength of threat 
forces which are not accurate (Q) 


Proportion of regquired/requested reports of threat 
force status not submitted (0) 


Criterion: Ability of Commanders to Survive and Time to be 


Replaced if Necessary. 


Ge 





Pemeoenrmance Indicators: 
-- Proportion of commanders assessed as casualties (Q) 
-- Time to replace a commander casualty (Q) 


-- Time for alternate/jump/main TOC to take over when 
necessary (Q) 


Criterion: Commanders Ability to Use Control Systems 
Performance Indicators: 


-~- Assessment of employment of geographical control 
measures (S) 


-- Assessment of employment of unit SOP's (S) 


-- Assessment of adequacy of selected control aids and 
equipment (S) 


Criterion: Validity of Leadership Decisions 
Performance Indicators: 


-- Assessment of validity of selected leadership 
decisions (S) 


ee eon Or titel iness Of Teadership decisions (S) 
MESS ION: PROVIDE S-1 (PERSONNEL AND ADMINISTRATION) SUPPORT 


Criterion: Ability To Provide Administrative And Personnel 
Support 


PeeLOormance  inalLcators: 


-- Proportion of required reports not submitted on time 


(Q) 


SO GoSeOGeElon Of requests for personnel actions mot 
submitted on time (Q) 


-- Proportion of required and requested reports not 
submitted (Q) 


-- Percent requests for reconstitution not met (Q) 


-- Time from initiation of order for replacements until 
completed (Q) 
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Mito s LON PROVIDE S-2 (INTELLIGENCE) SUPPORT 


Criterion: Ability To Acquire And Report Intelligence 
Information 


Performance Indicators: 
-- Proportion of targets not detected and reported (Q) 
-- Proportion of targets detected but not reported (Q) 
-- Time to report targets detected (Q) 
-- Time to emplace and dismantle surveillance devices (Q) 


Criterion: Ability to Analyze and Disseminate Intelligence 
Information 


Performance Indicators: 


~- Time to complete selected processing and analysis 
tasks (Q) 


-- Time to disseminate intelligence information (Q) 

-- Percent of targets reported which are false (Q) 
Criterion: Effectiveness of Electronic Warfare Systems 
Performance Indicators: 

-- Assessment of ability to jam threat frequencies (S) 


-- Assessment of ability to locate threat electronic 
warfare systems (S) 


-- Assessment of ability to protect EW systems (S) 
MISSION: “PROVIDE S-3 (OPERATIONS) SUPPORT 
Criterion: Ability To Support Commander During Operations 
Performance Indicators: 


-- Percent of required or requested operations reports 
not submitted (Q) 


-- Percent of required or requested operations reports 
not submitted on time (Q) 
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-- Percent of required or requested operations reports 
Submitted that are not accurate (Q) 


Soaeroctons Abi lley TO Ruma A Tactical Operations Center 


-- Assessment of ability to run a tactical operations 
center (TOC) (S) 


-- Assessment of site selection for the TOC (S) 


-- Assessment of ability to control operations from the 
ROC Cs} 


Mateo ON: PROVIDE INDIRECT FIRE SUPPORT 


Criterion: Fire Support Target Acquisition And Assignment 
To Direct Fire Battle 


Performance Indicators: 
-- Number of calls for fire support not answered (Q) 
-- Percent of calls for fire support not acknowledged (Q) 
——— Lame &O transmit calls for fire support (Q) 
Criterion: Fire Support Effectiveness 
Performance Indicators: 
-~ Sat targets not destroyed per call answered (Q) 
-- Threat targets not suppressed per call answered (Q) 


I miemmaanm: FeCeipt of Call for fire support until 
execution of attack (Q) 


-- Munitions expended by number and type per target 
destroyed (Q) 


Chrecemen: Interdiction Target Acguisition 
Performance Indicators: 
-- Number of threat targets not located (Q) 
-- Percent of threat targets located but not reported (Q) 


ee emeenmtnor Earger: Locations Enat are not accurate (Q} 
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Ciweeerion: intesgdiction Target Assignment 
Performance Indicators: 
-- Time to report target location (Q) 
-- Percent of reported targets not assigned for attack (Q) 


Tine ftom SGeDOLENOn Garget location until target is 
assigned for attack (Q) 


—— eme Erom target assignment until order to attack 
issued (Q) 


Criterion: Interdiction Target Attack Effectiveness 
Performance Indicators: 
——Lime bom Ora@er to attack until attack execution (Q) 


-- Percent of targets assigned for attack not attacked 
(Q) 


-- Percent of targets attacked but not hit (Q) 
Gemeerion: Counterfire Target Acquisition 
Performance Indicators: 
-- Number of targets not located (Q) 
-- Percent of threat targets located but not reported (Q) 


-- Percent of target loactions reported that are not 
accurate (Q) 


Criterion: Efficient Use of Fire Support Systems 
Performance Indicators: 
-- Time to respond to calls for fire (Q) 


-- Number of systems firing at targets beyond range 
Gapaelty (0) 


-- Number of systems firing at targets out of their 
section(Q) 
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Hiss tON: PROVIDE ENGINEER SUPPORT 
Srrction: Ability To Perform Mobility Operations 
Performance Indicators: 


ees to breach,remove selected obstacles and 
minefields (Q) 


-- Percent requests for mobility support not met (Q) 

-- Number of requests for mobility support not met (Q) 
Criterion: Ability to Perform Countermobility Operations 
Performance Indicators: 

-- Times to prepare selected obstacles and minefields (Q) 


-- Number of requests for countermobility operations 
not met (Q) 


-- Percent of requests for countermobility operations not 
more =O) 


Sercerton: —Abriity To Perform Survivability Operations 
Performance Indicators: 


-- Time to prepare battlefield and facility protection 
(Q) 


-- Number of requests for support not met (Q) 

-- Percent of requests for support not met (Q) 
pees stONs PROVIDE S-4 (LOGISTICS) SUPPORT 
Criterion: Ability To Provide Essential Supplies 
Performance Indicators: 

-- Percent requests for supplies not met (Q) 


-- Number of required and requested logistics reports not 
submitted (Q) 


-- Proportion of required and requested logistics reports 
not delivered on time (Q) 


-- Percent supply requests not delivered on time (Q) 
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Seaweermen: Ability To Provide Transportation 
Performance Indicators: 

-- Percent requests for transportation not met (Q) 

-- Number of transportation requests not met (Q) 

-- Percent of transportation requests not met on time (Q) 
Criterion: Ability To Provide Messing Operations 
Performance Indicators: 

-- Assessment of selection of mess hall site (S) 


-- Assessment of ability to provide sufficient and timely 
food service support (S) 


Pi SolON: PROVIDE COMMUNICATIONS SUPPORT 
Criterion: Adequacy Of Communications And Facilities 
Performance Indicators: 


-- Assessment of selected aspects of: communications 
facwhities (3S) 


-- Assessment of ability to operate/repair communications 
equipment (S) 


-- Assessment of communications site selection (S) 
Criterion: Accuracy And Timeliness Of Communications 
Performance Indicators: 

-- Mean time for message delivery (Q) 

-- Percent messages with errors and omissions (Q) 


-- Mean number of repititions for each message transmitted 
(Q) 


-- Percent message clarification requested (Q) 


ie eGanamlssiton ctlLmewror Counces-—electronic warfare 
purpose (Q) 


-- Percent messages with security violations (Q) 
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MiiooLoN: PROVIDE MEDICAL SUPPORT 


Cmmceriton: Ability to Provide Medical Support 


Performance Indicators: 


Percent requests for medical services not met (Q) 


Time from casualty occurrence until medical services 
arrive (Q) 


Percent of casualties evacuated to higher treatment 
echelon (Q) 


Time to evacuate casualty to rear once decision to 
evacuate has been made (Q) 


Times to set up and tear down selected medical 
facilities (Q) 


MISSION: PROVIDE MAINTENANCE SUPPORT 


Criterion: Ability To Perform Critical Maintenance Services 


Performance Indicators: 


Percent requests for support not met (Q) 

Times to perform selected maintenance tasks (Q) 
Percent of repairs evacuated to rear (Q) 

Times to evacuate selected eguipment (Q) 

Return time to unit of items submitted for repair (Q) 


{Ref. 4: pp. 5-1 - 5-53] 


76 





LEVEL 


APPENDIX B 


CEL NUEREOT: RIEDE COMPANIES 


MISSION: MOVEMENT TO CONTACT 


Criterion: Prepare For The Movement 


Performance Indicators: 


Assessment of formation selection (S) 
Assessment of route of advance selected (S) 


Assessment of operations order (OPORD) (S) 


Criterion: Conduct The Movement 


Performance Indicators: 


Assessment of movement techniques’ suitability to 
terrain and expected degree of contact (S) 


Aesessment of use of cover and concealment (S) 


Assessment of use of overwatch positions to support 
advancing units (S) 


Assessment of ability to locate and identify 
disposition of opposing forces (S) 


Assessment of coordination of indirect, machinegun, 
antitank, and nonorganic fires to Support the movement 
(S) 


BPemOrEGeas tO Eriendly log@ation, nature of terrain, 
and opposing force situation are submitted as 
necessary (S) 


MESSLONSS HASTY ATTACK 


Griterueon: Conduct Hasty Attack 


Po@uomnance Lnalcators: 
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-- Assessment of ability to eliminate opposing force (S) 


-- Assessment of ability to determine opposing force 
SeGensctinanGd GdlsSpostelomr( >) 


-~- If resistance is assessed to be too great to overcome, 
assessment of request for assistance from higher 
headquarters (S) 


-- Assessment of use of indirect fires (S) 


-- Assessment of leader's frag order to accomplish 
required tasks (S) 


-- Assessment of use of cover and concealment (S) 
-- Assessment of use of other supporting fires (S) 


-- Assessment of ability to consolidate, reorganize and 
prepare to continue attack once objective is taken (S) 


-- Situation reports (SITREPS) submitted as necessary (S) 
-- Assessment of movement techniques (S) 
Cemeetionw: Ability Fo Acquire And Destroy Targets 
Performance inedieators: 
-- Percent threat targets not destroyed (Q) 
-- Percent of friendly engagements (Q) 
-~- Percent of engagements against dead targets (Q) 


-~ Ammunition expended by quantity and type per target 
destroyed (Q) 


-- Percent threat targets not engaged at least once (Q) 
Siiterion: Ability To Seize And Hold Terrain 
Performance Indicators: 

-- Number of friendly casualties (Q) 


-eueme Lrom Nasty attack Initiated until objective 
seized (Q) 


-~- Number of enemy survivors (Q) 
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-- Percent friendly casualties (Q) 
-- Percent enemy survivors (Q) 
MISSION: DELIBERATE NIGHT ATTACK 
Criterion: Prepare To Attack 
Performance Indicators: 
-- Assessment of commander's scheme of maneuver (S) 
-- Assessment of movement techniques selected (S) 
-- Assessment of use of terrain (S) 
-- -Assessment of planned use of fire support (S) 
Sereerion: Conduct The Attack 
Performance Indicators: 
-- Assessment of movement to objective (S) 
-- Assessment of use of all supporting fires (S) 
-- Assessment of responsiveness of supporting fires (S) 


-- Use of proper fire and maneuver techniques to 
eliminate resistance (S) 


-- Assessment of ability to secure objective without 
sustaining excessive casualties and equipment loss (S) 


-- Assessment of ability to consolidate, reorganize, and 
prepare to continue tactical operations (S) 


-- SITREPS submitted as necessary (S) 
Criterion: Ability To Acquire And Destroy Targets 
Performance Indicators: 

-- Percent threat targets not destroyed (Q) 

-- Percent of friendly engagements (Q) 


-- Percent of engagements against dead targets (Q) 
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-- Ammunition expended by quantity and type per target 
destroyed (Q) 


-- Percent threat targets not engaged at least once (Q) 
Geter ion: Ability To Seize And Hold Terrain 
Performance Indicators: 

-- Number of friendly casualties (Q) 

--~ Percent friendly casualties (Q) 

-- Number of enemy survivors (Q) 

~~ Percent enemy survivors (Q) 

~~ Time from attack until objective seized (Q) 
MISSION: DELAY 
Suicerien: sOceupation Of Battle Position 
Performance Indicators: 


-- Assessment of adjustment of battle position (BP) after 
receiving the operation order (S) 


-- Assessment of preparation of BP and providing security 
(S) 


-- Assessment of planned use of indirect fires (S) 
Criterion: Preparation Of Subsequent Battle Positions 
Performance Indicators: 


-- Assessment of BP selection, reconnaissance for routes 
between BP's and preparation of new position (S) 


-- Assessment of plan for direct and indirect fires on 
avenues of approach (S) 


-- Assessment of overall fire plan to include target 
reference point (TRP's), final protective fires 
(FPF's), and covering routes of march (S) 


-- Assessment of reconnaissances for third subsequent 
BP's (S) 
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Criterion: Engage Opposing Force 


becmnonmance Indicators: 


Assessment of detection, identification, and reporting 
of opposing forces (OPFOR) (S) 


Assessment of engagement of OPFOR from as many BP's as 
possible with direct fires (S) 


Assessment of engagement of OPFOR with as much 
indirect and supporting fires as possible (S) 


Assessment of ability to shift fires to engage OPFOR 
(S) 


Criterion: Movement To Subsequent Position 


Performance Indicators: 


Assessment of move to new positions over specified 
routes and occupation of new position (S) 


Assessment of use of indirect and direct fires to 
suppress OPFOR as friendly units move (S) 


Assessment of ability to deny envelopment or bypassing 
by the OPFOR (S) 


Assessment of maintenance of contact (S) 


Assessment of maintenance of control and coordination 
during movement (S) 


Criterion: Ability To Acquire And Destroy Targets 


Performance Indicators: 


Percent threat targets not destroyed (Q) 
Percent friendly engagements (Q) 
Percent engagements against dead targets (Q) 


Ammunition expended by quantity and type per target 
destroyed (Q) 


Percent threat targets not engaged at least once (Q) 
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Grarterien: Ability To Hold Terrain 
Performance Indicators: 

~- Number of friendly casualties (Q) 

--~ Percent friendly casualties (Q) 

-- Number of enemy survivors (Q) 

~~ Percent enemy survivors (Q) 

~- Time required to displace to subsequent positions (Q) 
PeraotON> DELIBERATE DEFENSE 
Criterion: Preparation, Organization, And Plan 
Performance Indicators: 

-- Assessment of commander's warning order (S) 


-~- Assessment of plan based on orders from higher 
headquarters (S) 


~~ Assessment of reconnaissance (S) 

-- Assessment of battle position site selection (S) 
Criterion: Occupation Of Fighting/Battle Positions 
Performance Indicators: 


-- Assessment of use of armor and anti-armor guided 
missiles in depth (S) 


-- Assessment of use of armor and anti-armor guided 
missiles in mutual support (S) 


-- Assessment of position site selection to take 
advantage of natural or man-made obstacles, cover and 
concealment (S) 

Gremeeraen: Establish Security 


Pemrormance Indicators: 


-- Assessment of use of observation posts on likely 
avenues of approach (S) 


-- Assessment of plan and use of patrols (S) 
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-- Assessment of use of sentries (S) 
7 nesesoment of limited Wwsewor radios (S) 


-- Assessment of use of early warning devices on likely 
avenues of approach (S) 


-- Assessment of use of challenge and password (S) 
-- Assessment of unit alertness along perimeter (S) 
Criterion: Prepare Fighting Positions 
Performance Indicators: 


-- Assessment of selection of primary, alternate and 
supplementary positions (S) 


-- Assessment of planning, preparing and reconnaissance 
of positions as time permits (S) 


-- Assessment of selection for antitank weapon sites (S) 
= Assessment Of selection/role for armor (S) 


-- Assessment of use of infantry to provide local 
security for tanks and antitank weapons (S) 


-- Assessment of use of camouflage, cover and concealment 
CS} 


-- Assessment of plan for direct and indirect fires to 
cover avenues of approach, obstacles, and engagement 
areas (S) 

-- Assessment of overall plan for indirect fires to 
Miemicemt ne Ss oer PES, allumination, and routes of 
movement to subseguent battle positions (S) 


-- Assessment of preparation of direct fire plan and 
range cards (S) 


-- Assessment of use of obstacles (S) 
Criterion: Defend As Opposing Force Approaches Positions 


Performance Indicators: 


-- Assessment of use of indirect fire (S) 
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-- Assessment of use of weapons at maximum range (S) 
-- Assessment of use of suppressive fires (S) 
-- Assessment of use of maximum firepower (S) 
-- Assessment of repositioning (S) 
-- Assessment of usage of night vision devices (S) 
Gmecerion: Conduct a Counterattack 
Performance Indicators: 


-- Assessment of concentration of combat power to 
overwhelm and destroy OPFOR (S) 


-- Assessment of maneuver of forces to place effective 
Pores. (S) 


-- Assessment of use of fire support to stop and destroy 
opposing forces in penetrated area (S) 


Giemeerion: Consolidation And Reorganization 
Performance Indicators: 


-- Assessment of counterattacking forces' preparation for 
another opposing force attack (S) 


-- Assessment of reports as necessary and by SOP to 
include ammunition expenditures, fuel status, 
vehicles, equipment, and personnel (S) 

Criterion: Ability To Acquire And Destroy Targets 
Performance Indicators: 

-- Threat targets not destroyed (Q) 

-- Percent of friendly engagements (Q) 


-- Percent of engagements against dead targets (Q) 


-- Ammunition expended by quantity and type per target 
destroyed (Q) 


-- Percent threat targets not engaged at least once (Q) 


Cmreerion:> Ab lity To Seize And Hold Terrain 
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Performance Indicators: 
-- Number of friendly casualties (Q) 
-- Percent friendly casualties (Q) 
-- Number of enemy survivors (Q) 
-- Percent enemy survivors (Q) 


— ame EO —cOnduUcCE Peounterattack until objective is 
seized (Q) [Ref. 6: pp. 7-1-1 - 7-6-3] 
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pee C 


Level of Interest: Specialized Platoons 
SEOUL PEATOON MISSION: SCREEN 
Criterion: Plan And Prepare A Screen 
Performance Indicators: 


-- Assessment of platoon leader's analysis of mission and 
tasks (S) 


-- Assessment of order issued to subordinates to include 
Eimeliness seo 


Criterion: Move To The Screen Line 
Performance Indicators: 


-- Assessment of reconnoitering to screen line and 
selection of observation post sites (S) 


-- Assessment of movement techniques and their 
consistency with terrain and situation (S) 


Criterion: Establish Observation Posts 
Performance Indicators: 
-- Assessment of observation posts' (OPs) ability to 
provide overlook of avenues of approach, long range 


observation, and fields of fire (S) 


-- Assessment of use of concealed routes to occupy OPs 
(S) 


-- Once contact is made, assessment of use of indirect 
fires to slow opposing force (S) 


-- Assessment of use of covered and concealed routes to 
subsequent OPs (S) 


-- Assessment of ability to maintain contact with 
opposing force during movement (S) 


86 





Criterion: Reestablish The Screen 


Performance Indicators: 
-- Assessment of move to assigned areas, occupation of 
the area, reorganization, and preparation to continue 
mission (S) 


-- Assessment of occupation of OPs on the subsequent 
screen line (S) 


-- Assessment of situation reports to task force (S) 


SeOuT PLATOON MISSION: ZONE RECONNAISSANCE 
Criterion: Plan And Prepare A Zone Reconnaissance 
Performance Indicators: 


-- Assessment of platoon leader's analysis of mission and 
tasks (S) 


-- Assessment of order issued to subordinates to include 
timeliness (S) 


Criterion: Deploy Teams 
Feprormance Indicators: 
-- Assessment of movement into assigned zone (S) 


=-——- Assessment of reconnoiter of entire zone from one 
lateral boundary to the other (S) 


Criterion: Locate Opposing Force 

Performance Indicators: 
-- Assessment of movement techniques (S) 
-- Assessment of use of cover and concealment (S) 
-- Assessment of site selection (S) 


-- Assessment of use of visual signals to control movement (S) 
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Criterion: Develop The Situation 
Performance Indicators: 


-- Assessment of platoon deployment and use of fire and 
maneuver (S) 


-- Assessment of ability to keep commander informed by 
BOpOGEMNG Contacts (3S) 


Gmametcerion. Collection Of Terrain Specific Information 
Performance Indicators: 


-- Given opposing force has withdrawn, assessment of 
obtaining and reporting information on: 


-- condition of road network in zone (S) 

-- cross-country trafficability (S) 

-- obstacles and removal when possible (S) 

-- bypasses around obstacles (S) 

== fords and water entry/exit points on water 
obstacles (S) 

-- other information required by task force order (S) 


-- Assessment of reports given by quickest and most 
secure means available (S) 


Criterion: Occupy An Assembly Area 
Performance Indicators: 


-- Assessment of movement to and occupation of an 
assembly area (S) 


Note: Approximately same performance indicators exist for 
area and route reconnaissances 


ANTI-TANK PLATOON MISSION: PROVIDE ANTI-TANK FIRE SUPPORT 
Criterven: Place TOW Into Operation 
Performance Indicators: 

-- Time taken until the squad/section is prepared for 


foie. system erected, pre-operational checks 
completed, and missile loaded (Q) 
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-~ Time taken to prepare a range card IAW TC 7-24, p. B- 
nee OQ} 


Criterion: Deployment Of TOW Weapon Systems 
Performance Indicators: 
-- TOWs deployed throughout sector in een (S) 
-- TOWs deployed throughout sector in mutual support (S) 


-- TOWs deployed to cover most likely armor avenues of 
approach (S) 


-- Fighting positions make maximum use of cover and 
concealment and fields of fire (S) 


Criterion: Engage Multiple Targets 
Performance Indicators: 
-- Threat targets not destroyed (Q) 
-- Percent of friendly engagements (Q) 
-- Percent of engagements against dead targets (Q) 
-- Number of missiles fired per target destroyed (Q) 


-- Percent of threat targets not engaged at least once (Q) 


Piareav ye MORTAR GA lTOON MISSDON: PROVIDE INDIRECT FIRE SUPPORT 
Criterion: Occupy Primary Position 
Performance Indicators: 
-- Assessment of platoon's preparation for firing (S) 
-- Assessment of platoon's ability to improve the 
position to include camouflage, all around defense, 


ameaeandityidual protection (5S) 


-- Assessment of platoon's reconnoiter for alternate and 
supplemental positions (S) 


-- Development of plans for operation (S) 
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Semeerion: Fire Registration And Confirm/Adjust A Parallel 
Sheaf 


Performance Indicators: 


-- Time taken for platoon to adjust and record firing 
data corrections (Q) 


-- Distance the last adjusting round impacts in meters 
from the desired registration point (Q) 


-- Time taken until parallel sheaf adjustments are 
completed (Q) 


Criterion: Adjust Final Protective Fire 
Performance Indicators: 
-- Time taken to complete adjustments (Q) 


-- Distance the final adjusting round impacts in meters 
From the target (Q) 


Criterion: Prevent Opposing Force Observations Of Friendly 
Movement (Screen) 


Performance Indicators: 


-- Time taken to establish an effective screen after the 
target is identified by the forward observer (Q) 


ae tate E£LrOMmmInitilal cal. for screen until first round 
Imecke ts = (©) 


Criterion: Engage An Area Target 
Perrormance. Indicators: 


-- Time it takes until platoon initiates fire for effect 
(FFE) once the target is identified (Q) 


-- Distance FFE volleys are from the target area (Q) 
Criterion: Shift Fires To An Area Target 
Performance Indicators: 


== ime taken until platoon initiates FFE after target 
identification (Q) 


-- Distance FFE is from the target area (Q) 
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Ganterion: Fire Final Protective Fire 
Performance Indicators: 


Ze limeruncit tie Llnrse se@eunmas are Lired onée the command 
to fire is given (Q) 


-- Distance FFE is from the target area (Q) 
Girrerion: Provide Battlefield Illumination 
Performance Indicators: 


= ligestaken stor platoon £Oo adjust and record firing 
Gzvicel (Oi) 


vito iO erinac teneommca sti red until iltumination of 
designated area is effective (Q) 


Criterion: Conduct Reconnaissance Of A New Position 
Performance Indicators: 


-- Assessment of reconnoiter of proposed position area and 
PiemeoOilkze GO Ene DPOSsitren (S} 


-- Assessment of reconnoiter of alternate and supplemental 
Des terens (5) 


-- Assessment of development of plan for position 
occupation (S) | 


Criterion: Conduct Displacement To New Position 
Performance Indicators: 


-- Time for first section to move to new position and 
become ready to fire (Q) 


——SUpememotLtication that the frst section is in place, 
time for the second section to move to new position 
and become ready to fire (Q) [Ref. 6: pp. 8-36-1 - 8- 
47-2} 


oA 





APPENDIX D 


Bowes Cl Interest: Individual Soldiers 
Selected Individuals: General 
First Aid Tasks 


-- Ability to perform mouth to mouth resuscitation and 
external heart massage (S) 


-- Ability to stop bleeding (arm or leg wound) (S) 

Ti pileiey tem dentiryostoms Of and treat for shock (3S) 
-- Ability to splint a fracture (S) 

-- Ability to apply first aid measures for burns (S) 


-- Ability to apply first aid measures for heat injuries 
(S) 


-- Ability POMP wate Sema G FOr wet Or cold injuries 
(S) ; 


Nuclear, Biological, And Chemical Tasks 


-- Ability to perform operator's maintenance on an M17 
series protective mask (S) 


-- Ability to exchange filters on an M17 series 
protective mask (S) 


-- Ability to put on and wear a protective mask (S) 
-- Ability to put on and wear protective clothing (S) 
-- Ability to decontaminate self (S) 

-- Ability to decontaminate individual equipment (S) 


-- Ability to identify a chemical agent using ABC-M8 
detector paper (S) 


-- Ability to demonstrate visual, vocal, and sound alarms 
for an NBC attack (S) 
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-- Ability to satisfy personal needs in a chemical 
environment (S) 


-- Ability to protect self against a nuclear hazard (S) 


-- Ability to administer antidote to a nerve-agent 
casualty (S) 


-- Ability to administer antidote to blood-agent casualty 
(S) 


-- Ability to apply artificial respiration to a chemical- 
agent casualty (S) 


-- Ability to recognize and protect self against a 
chemical/biological hazard (S) 


Basic Individual Techniques 

-- Ability to move as a member of a fire team (S) 

-- Ability to move under direct fire (S) 

—oSwiwey FO react EO Indarect fire (S) 

-- Ability to react to flares (S) 

-- Ability to move over, through, or around obstacles (S) 
-- Ability to estimate range (S) 

-- Ability to select temporary battlefield positions (S) 

= oiine, meee GOnStLuct individual fighting positions (S) 


-- Ability to use visual signals to control dismounted 
movement (S) 


Camouflage, Cover And Concealment Tasks 


were y tO camourlage/ conceal self and individual 
equipment (S) 


-- Ability to camouflage/conceal equipment (S) 
-- Ability to camouflage/conceal defensive positions (S) 


-- Ability to clear fields of fire (S) 
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Security And Intelligence Tasks 
--. Ability to use challenge and password (S) 


-- Ability to process known or suspected enemy personnel 
(S) 


[weotluey = fo Gollicct/report antormation - SALUTE (S) 


-- Ability to conduct day and night surveillance without 
the aid of electronic devices (S) 


-- Abililty to engage enemy armor weak points (S) 


-- Ability to identify opposing force armored vehicles 
(S) 


-- Ability to identify opposing force weapons and 
equipment (S) 


Land Navigation Tasks 
-- Ability to identify terrain features on the map (S) 


-- Ability to determine grid coordinates of a point ona 
map uSing the military grid reference system (S) 


-- Ability to determine azimuths uSing a coordinate scale 
ana pmotractor (S) 


-——fDwewey CO Convertvazimuins (magnetic or grid) (S) 


-- Ability to determine a magnetic azimuth using a 
compass (S) 


-- Ability to determine direction using field expedient 
methods (S) 


Night Vision Device Tasks 


-- Ability to perform operator maintenance on an AN/PVS-2 
cS) 


-- Ability to conduct surveillance using an AN/PVS-2 (S) 
M16A1 Rifle Tasks 


-- Ability to perform operator maintenance on an M16A1 
rifle, magazine and ammunition (S) 
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-- Ability to load, reduce a stoppage, and clear an M16Al1 
aire (S) 


-- Ability to battlesight zero an M16A1 rifle (S) 
== Ability to qualify with the M16Al1l rifle (S) 


-- Ability to use limited visibility firing techniques 
with the M16A1 rifle (S) 


-- Ability to mount/dismount AN/PVS-2 on M16A1 rifle (S) 


-- Ability to zero AN/PVS-2 when mounted on M16A1 rifle 
(S) 


-- Ability to engage a target with a rifle using AN/PVS-2 
(S) 


Light Anti-Tank Weapon (LAW) Tasks 


~- Ability to prepare an M72A2 LAW for firing; restore 
MeZa2 LAW COscarrying configuration (S) 


~- Ability to engage targets with an M72A2 LAW (S) 


-- Ability to apply immediate action to correct a 
malfunction on an M72A2 LAW (S) 


Hand Grenade Tasks 

-- Abililty to perform safety checks on hand grenades (S) 
~~ Ability to engage enemy targets with hand grenades (S) 
-- Ability to identify and employ hand grenades (S) 

Mine Tasks 


-~- Ability to install and fire/recover an M18A1 claymore 
mine (S) 


-- Ability to install the M18A1 claymore with tripwires 
(S) 


-- Ability to disarm the M18A1 claymore (with tripwires) 
(S) 


-- Ability to install the M21 metallic antitank (AT) mine 
(S) 
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Asatte y Eo disasmotme M2Zimmecallic antitank (AT) mine 
(Ss) 


Peer liy to lnistallarene Mran! bounding antipersonnel 
mine (w/w/o tripwires) (S) 


Porlity to disarm. ene mtoAl bounding antipersonnel 
mine (w/w/o tripwires) (S) 


Ability to locate mines by visual means (S) 
Ability to locate mines by probing (S) 


Ability to neutralize enemy mines (S) 


Selected Individuals: M203 Grenadier 


M203 Grenadier Tasks 


Ability to perform operator maintenance on M203 
grenade launcher and ammunition (S) 


Ability to load, unload, and clear the M203 (S) 
Abigiaky to, ZErO an aM20 3 wks ) 


Ability to engage targets with an M203 and apply 
immediate action to reduce a stoppage (S) 


Mone vw cOmuse [1M ted visibility CLiring techniques 
with the M203 (S) 


Selected Individuals: Dragon Gunner 


Dragon Gunners Tasks 


Ability to conduct a preoperational inspection of the 
Dragon tracker and round (S) 


Ability to prepare the Dragon for firing (S) 


Ability to demonstrate correct Dragon firing positions 


(S) 
Ability to determine if a target is engageable (S) 


Ability to prepare an antiarmor range card (Dragon) 
(S) 


Ability to perform immediate action procedures for a 
Dragon misfire (S) 
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-—- Ability to construct a fighting position (Dragon) (S) 


-- Ability to perform emergency destruction procedures 
(S) 


Selected Individuals: M60 Machinegunner 
M60 Machinegunner Tasks 


-- Ability to perform operator maintenance on an M60 
machinegun and ammunition (S) 


-- Ability to operate an M60 machinegun (S) 

-- Ability to fire the M60 MG for familiarization (S) 
-- Ability to construct an M60 MG position (S) 

-- Ability to lay M60 MG using field expedients (S) 
-- Ability to field zero an M60 MG (S) 

-- Ability to prepare a range card for an M60 MG (S) 
-- Ability to zero an M60 MG on 10-meter range (S) 

-- Ability to qualify with an M60 MG (S) 

-- Ability to mount/dismount an AN/PVS-2 on an M60 MG (S) 
-- Ability to zero an AN/PVS-2 to an M60 MG (Ss) 

-- Ability to maintain a caliber .45 pistol (S) 


-- Ability to engage targets with a caliber .45 pistol 
(S) 


Selected Individuals: Radiotelephone Operator 
Radiotelephone Operator Tasks 


-- Ability to perform operator preventive maintenance on 
telephone sets (TA-312/PT or TA-1/PT) (S) 


-- Ability to install telephone set (TA-312/PT or TA- 
eee S)) 


-- Ability to perform operator maintenance on radio sets: 
AN/PRC-77 or AN/VRC-64 (S) 
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-- Ability to operate radio set AN/PRC-77 or AN/PRC-25 
(S)} 


-- Ability to prepare radio set AN/VRC-64 for operation 
(3) 


-- Ability to perform operator maintenance on radio sets 
AN/VRC-46 or AN/VRC-47 (S) 


-- Ability to prepare tactical FM radios (AN/VRC-46 or 
AN/VRC-47) for operation (S) 


-- Ability to use an automated CEOI (S) 
-- Ability to use KAL-61B 1400 numerical code to 
authenticate transmissions and encrypt/decrypt numbers 


and grid zone letters (S) 


-- Ability to encode and decode messages using a KTC-600 
tactical operations code (S) 


-- Ability to establish and enter or leave a radio net 
(Ss) 


-- Ability to transmit and receive a radio message (S) 
-- Ability to prepare/operate switchboard SB-993 (S) 


-- Ability to install and operate communications security 
equipment TSEC/KY-8 using RT-524/VRC (S) 


-- Ability to install and operate speech security 
equipment TSEC/KY-38 using RT-841/RCC-77 (S) 


-- Ability to install radio set control group AN/GRA-39 
(S) 


-- Ability to operate radio set control group AN/GRA-39 
(S) 


Selected Individuals: Squad Gunner 
Squad Gunner Tasks (Mechanized Units Only) 


-- Ability to perform operator maintenance on a caliber 
50 M2 HB machinegun and ammunition (S) 


-- Ability to target/zero a caliber.50 MG (S) 


-- Ability to load, reduce a stoppage, unload, and clear 
a caliber.50 MG (S) 
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Ability to engage targets with a caliber .50 MG (S) 


Ability to set headspace and timing on a caliber .50 
MG (S) 


Ability to mounkyG@ismount An/ TVS—2 sight on caliber 
PaOeMG  (S} 


Ability to boresight AN/TVS-2 to caliber .50 MG (S) 


Selected Individuals: Wheeled-Vehicle Driver 


Wheeled-Vehicle Driver Tasks 


Ability to drive a wheeled vehicle cross-country (S) 


Ability to drive a wheeled vehicle on roads, in 
vehicle parks, and in built up areas (S) 


Ability to drive a wheeled vehicle using blackout 
drive (S) 


Ability to start a wheeled vehicle engine using 
eltewitary power,s(Mdo1,8%715, and M561) (S) 


Ability to perform ESC inspection on a wheeled vehicle 
(S) 


Ability to maintain required TAMMS records on a 
wheeled vehicle (S) 


Ability to perform operator maintenance on a wheeled 
vehicle (S) 


Ability to recover a wheeled vehicle (S) 


Selected Individualsmw Tracked-Venicle Driver 


Tracked-Vehicle Driver Tasks 


Ailey tO Grive an APC cross-country (S) 


Abplity to drive an APC on roads, in vehicle parks, 
and in built-up areas (S) 


Abieitey tO drive an APC with night vision-devices, 
infrared equipment and blackout drive (S) 


Ability to operate an APC in water (S) 
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-- Ability to start the APC engine uSing auxiliary power 
(S) 


-- Ability to perform a tracked vehicle ESC inspection 
(S) 


-- Ability to maintain required TAMMS records on a 
tracked vehicle (S) 


-- Ability to perform operator maintenance on an APC (S) 


-- Ability to recover a tracked vehicle using field 
expedients (S) 


Selected Individuals: TOW Crewman 
TOW Crewman Tasks 
-- Ability to assemble the TOW launcher (S) 


-- Ability to perform operator maintenance on TOW weapons 
system (S) 


-- Ability to -conduct a system self test and 
preoperational inspection (S) 


-- Ability to load, arm, and unload an encased missile 
(S) 


-- Ability to perform immediate action procedures for a 
misfire (S) 


-- Ability to determine if a target can be engaged (S) 
-- Abililty to camouflage/conceal TOW position (S) 

-- Ability to prepare an antiarmor range card (TOW) (S) 
-- Ability to maintain a caliber .45 pistol (S) 


-- Ability to engage targets with a caliber .45 pistol 
(S) 


Selected Individuals: Scouts 
Scout Tasks 


-- Ability to perform operator maintenance on an M60 MG 
and ammunition (S) 


-- Ability to operate an M60 MG (S) 
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-- Ability to zero an M60 MG on a 10-meter range (S) 

-- Ability to qualify with an M60 MG (S) 

-- Ability to mount/dismount an AN/PVS-2 on an M60 MG (S) 
-- Ability to zero an AN/PVS-2 to an M60 MG (S) 


-- Ability to perform operator maintenance on radio sets 
AN/VRC-46 or AN/VRC-47 (S) 


-- Ability to prepare tactical FM radios for operation 
(S) 


-- Ability to use an automated CEOI (S) 
-- Ability to use KAL-61B 1400 numerical code to 
authenticate transmissions and encrypt/decrypt numbers 


and letters (S) 


-- Ability to encode and decode messages using a KTC-600 
tactical operations code (S) 


-- Ability to establish and enter or leave a radio net 


(S) 
-- Ability to transmit and receive a radio message (S) 


-- Ability to install and operate communications security 
equipment TSEC/KY-8 using RT-524/VRC (S) 


-- Ability to install and operate speech security 
equipment TSEC/KY-38 using 841/PRC-77 (S) 


-- Ability to locate a target by shift from a known point 
(S) 


eer Ouca ll sfor/adgust indirect fire [{Ref. 7: pp. 
3-117 - 3-163] (S) 


Selected Individuals: 4.2-inch Mortar Crewman 
4.,2-inch Mortar Crewman Tasks 
-- Ability to ground mount a 4.2-inch mortar (S) 
-- Ability to boresight a 4.2-inch mortar (S) 


-- Ability to perform safety checks on a 4.2-inch mortar 


(S) 


ea 





Ability to prepare 4.2-inch mortar ammunition for 
miata |S) 


Ability to perform operator maintenance ona 4.2-inch 
mortar and equipment (S) 


Spivey oO eEelOvewaumiokire £rom a 4.2-inch mortar 
(ground mounted) (S) 


Ability to refer sight and realign aiming posts for a 
4.2-inch mortar (S) 


AbiMwity tou reciproecamry lay a 4.2-inch mortar using an 
M2 aiming circle and place out aiming posts (S) 


Ability to manipulate a 4.2-inch mortar for traversing 
fire (S) 


Ability to place a carrier mounted 4.2-inch mortar 
into action (mechanized units only) (S) 


AD iweieye Ge Leteve aqumlctire £rom a carrier mounted 


4.2-inch mortar (mechanized units only) (S) [Ref. 
152) ep. 3-117 = 3=163) 
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APPENDIX F 


This appendix contains examples of the application of 
three statistical tests to compare assumed distributions and 
assess homogeneity of variance for sample data populations. 
IT. Examples of the Use of the Kolmogorov Goodness-of-Fit 

Test and Use of a Transformation. 

This test is used to make a comparison between the 
actual and the theoretical distribution of a sample of data. 
The procedure is as follows: 

1. Let F(x) be the completely specified theoretical 
SiMe woes Cra bution function under the null 


hypothesis. 


eco eemoe ele sample vcumulative distribution fune- 
tion based on n observations. 


ee = oe < X(9) 6 «22% y be the order statistics. The 
computation of the Kolmogorov statistic is most easily 
done in the following stages. Compute 


Pe IA Ee wise (x) 4 44) 
1<jén (J) ee) =) 
DB =) PAX Sate ee E(x , ) 
<jcn Itt se (eal) on) 
D = MAX(D*t, D7) 
Tet eeeOG stEne Chosen significance level, the test 


Statistic is greater than or equal to the critical value 
found in the tables, the null hypothesis, H ta - oie. 


rejected. ° 


The data in Table XI are the times, measured in seconds, 
BVici hea EOokK CO tCransmit calls f£or fire support. 


Molmeg@eorweves Test 15 used on these data to check for 


-O9 
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normality. The sample average, x, and the sample variance, 


s¢, are used as estimates for the population mean and 


variance. The sample average, x, = 42.35 and the sample 
variance, s¢, = 286.24. For any observed x, 
Suxe= tm where, 
r = number of observations less than or equal to x. 
nm = number of observations. 
F(x) = N((x-x)/s), N being the normal distribution function. 


From Table XI it is seen that 

pe-e MAX NCD) Dm je=u.279,.5TO test the hypothesis, 
Ho: F(x) = N(42.35, 286.24) 

Stephens’ modification is used, i.e., 


T = D(/k - not + .85/,/), 


Micic mts Ehle number Of distinct values observed. [Ref. 
ices po.) 730-737 | 


For these data the modified test statistic is 

ere Ol 85/./ 14) = 1.10. 
The critical value in the table is 1.035 for a significance 
lewel me .01. Sinee 1.10 > 1.035 the null hypothesis, Hee 
Mea =sletZoo5- 266.24) 1s rejected at this significance 
level. 

Since the data cannot be assumed to be of a normal 
distribution, a transformation is sought to normalize the 
data so statistical tests, such as the T-test and an 
analysts of variance, may be utilized. Thewmmatu neal 
logarithmic transformation is used for this example and the 


transformed data appear in Table XII. 


ie 
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Aouenboeig feos (XU, =Aw oa tO 

SATIeETONwWND Aduenboig Aduoenbsi4 STITPD Atwusuedly, 

SATRIETSY SATIeTNuUND saATtAZeTNuNnDy Adusanbsay Oj SodUIT, 

acl ld poqoodxg SATIETOY peArssqo peaAresqo pow zOJSuedly, 


(Spuodses ut) 43z0ddns sAtyq AO0F TTeD OF SATUN AOJ Sout, powzrzo0FJsuerzy, *IIX eTqes 





The transformed sample average, y, = 3.68 and the sample 
standard deviation, Sy = sor ie From Table XII it is seen 
Site eDew—-.229. “Menrerore tne modified test statistic is 
computed as, 

T = .229 (4/14 - 01 + .85/,/14) = .904. 

Samee .904 < 1,035 the null hypotheses, 

Peewee ese o, Uesijeas Not rejected™=at the -01 
Significance level. The assumption can now be made that the 
transformed data is normally distributed and therefore 
Satisfies the normality requirement of statistical tests 
such as the T-test and analysis of variance. 


Dieeewamele OF Ehe Use of the F-test to Check for Common 
Variance Between Two Normal Populations. 


Table XIII. Observed Times to pecrale TOW Range Cards 
(in seconds) 


fn ee i 


‘Population A Population B 
526 414 | 
406 430 | 
499 419 | 
oa 453 | 
585 504 | 
459 459 | 
415 337 | 
460 Swe | 
506 425 
450 438 
624 456 | 
506 385 


eeengr ieee ee 


res ee ee er ey 


To test the hypothesis H,: Cn = on vs H,: oie 4 OR 
Mimesueemeose a Level of Significance such as (¥= .05. Look 


up Fi _o/2 ion ene) ea mecarcesseL freedom and Pi _of/2 





toL pe ty, Be ty cedrecs ef Ereedom. For the data in Table 
XIII above Eas (11,11) = 3.48. Next compute See and shy 


from the observations yielding 37 = 5545 and ae = AQ te. 
Computing F = s,°/s,* gives F = 5545/4073 = 1.36. 
if. f° > eee eee) on & Cay, ET aCe Co ee) 
the null hypothesis would be rejected. In this case Begs 
mitt) = 93.48 and I/F 975 Gh iene 0279.0 “sumoee Fors not 
ieeger Ehanm 3.48 and is not smaller than 0.29 the null 
hypothesis is not rejected. [(Ref. 13: pp. 4-8 - 4-9] 
TIzt. Example of the Use of Bartlett's Test to Check for 
Common Variances of Several Normal Populations. 

Boeeeses ene hypothesis H-: Gi = oon = Cha = Che versus 
Hy: at least one variance is not the same, the test 
Statistic is 

4 4 
YX = 2.3026 [(logyg s*) ) (my-1)- }  (ny-1)logyg 83°! 
| ol 

which has approximately a chi-square distribution with 3 
degrees of freedom. Be Ye x40) (3)" the null hypothe- 
Sis would be rejected. 

As an example, the data set in Table XIV will be used. 
The pooled estimate of the variance s? = 5437 /20N="1 Fie o> 
Using the above formula, 


Ga Osi oie Os0mendaetecse) = 2.80784 


It can be seen that 2.81 < X*.95(3) = 7.81 and thus the 


hypothesis of homogeneous variances may not be rejected at 


the 5 percent significance level. [Ref 17: pp. 127-129] 





Table XIV. Observed Times to Breach a Minefield 
(in minutes) 


me eb UNG | 





From these data the results in Table XV are obtained. 


Table XV. ANOVA Table for Times to Breach a Minefield. 


Degrees of Sum of Mean 
Source Freedom squares Squares 
1 5 Tats 0 2276 
2 4 SZ0e30 ZO ame 2 
8 4 hy See 43.3 
4 u os.0. 7-0 2) 0 ae 
Total 20 3437 0 


a nent ge cmerrumemesnow 
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